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Introduction 


Wavelets are a relatively recent development in applied mathematics. Their 
name itself was coined approximately a decade ago (Morlet, Arens, Fourgeau, 
and Giard (1982), Morlet (1983), Grossmann and Morlet (1984)); in the last ten 
years interest in them has grown at an explosive rate. There are several rea¬ 
sons for their present success. On the one hand, the concept of wavelets can be 
viewed as a synthesis of ideas which originated during the last twenty or thirty 
years in engineering (subband coding), physics (coherent states, renormalization 
group), and pure mathematics (study of Calderon-Zygmund operators). As a 
consequence of these interdisciplinary origins, wavelets appeal to scientists and 
engineers of many different backgrounds. On the other hand, wavelets are a fairly 
simple mathematical tool with a great variety of possible applications. Already 
they have led to exciting applications in signal analysis (sound, images) (some 
early references are Kronland-Martinet, JVlorlet and Grossmann (1987), Mallat 
(1989b), (1989c); more recent references are given later) and numerical analy¬ 
sis (fast algorithms for integral transforms in Beylkin, Coifinan, and Rokhlin 
(1991)); many other applications are being studied. This wide applicability also 
contributes to the interest they generate. ， 

\J This book contains ten lectures I delivered as the principal speaker at the 
CBMS conference on wavelets organized in June 1990 by the Mathematics De¬ 
partment at the University of Lowell, Massachusetts. According to the usual 
format of the CBMS conferences, other speakers (G. Battle, G. Beylkin, C. Chui, 
A. ^Cohen, R. Coifman, K. Grochenig, J. Liandrat, S. Mallat, B. Torresani, 
and A. Willsky) provided lectures on their work related to wavelets. Moreover, 
three workshops were organized, on applications to physics and inverae problems 
(chaired by B. DeFacio), group theory and harmonic analysis (H. Feichtinger), 
and signal analysis (M. Vetterli). The audience consisted of researchers active 
in the field of wavelets as well as of mathematicians and other scientists and 
engineers who knew little about wavelets and hoped to learn more. This second 
,group constituted the largest part of the audience. I saw it as my task to provide 
a tutorial on wavelets to this part of the audience, which would then be a solid 
grounding for more recent work exposed by the other lecturers and myself. Con- 
sequently，about two thirds of my lectures consisted of “basic wavelet theory,” 
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the other third being devoted to more recent and unpublished work. This divi¬ 
sion is reflected in the present write-up as well. As a result, I believe that this 
book will be useful as an introduction to the subject, to be used either for indi¬ 
vidual reading, or for a seminar or graduate course. None of the other lectures 
or f wofijsliop papers presented at the CBMS conference have been incorporated 
As a result, this presentation is biased more toward my own work than the 
S conference was. In many instances I have included pointers to references 
her reading or a detailed exposition of particular applications, comple- 
ing the present text. Other books on wavelets published include Wavelets 
Time Frequency Methods (Combes, Grossmann, and Tchamitchian (1987)), 
contains the proceedings of the International Wavelet Conference held in 
ille, FVance, in December 1987, Ondelettes, by Y. Meyer (1990) (in French; 
ih translation expected soon), which contains a mathematically more ex- 
d treatment than the present lectures, with fewer forays into other fields 
ever, Les Ondelettes en 1989, edited by P. G. Lemarie (1990), a collection of 
given at the Universite Paris XI in the spring of 1989, and An Introduction 
Wavelets, by C. K. Chui (1992b), an introduction from the approxim,ation 
theory viewpoint. The proceedings of the International Wavelet Conference m 
1989, held again in Marseille, are due to come out soon (Meyer (1992)) 
Moreover, many of the other contributors to the CBMS conference, as well as 
s^me wavelet researchers who could not attend, were invited to write an essay 
op their wavelet work, the result is the essay collection Wavelets and their Ap¬ 
plications (Ruskai et al. (1992)), which can be considered a companion book to 
this one. Another wavelet essay book is Wavelets: A Tutorial m Theory avd 
Applications^ edited by C. K. Chui (1992c); in addition, I know of several other 
wavelet essay books in preparation (edited by J. Benedetto and M Frazier, an¬ 
other by M. Barlaud). as well as a monograph b> M. Holschneider; theie was 
a special wavelet issue of IEEE Trans. Inform. Theory in March of 1992; there 
wll be another one, later in 1992, of Constructive Approximation Theory 、 and 
in 1993, of IEEE Trans. Sign. Proc. In addition, several recent books in¬ 
clude cbapteis on wavelets. Examples are Multtrale Systems and Filter Banks 
by P. P. Vaidyanathan (1992) and Quantum Physics, Relativity and Comple z 
Spamtinie: Towards a New Synthesis by G. Kaiser (1990). Readers interested 
in the pjeesent lectures will find these books and special issues useful for many 
details other aspects not fully presented here. It is moreover clear that the 
subject IS still developing rapidly. • 

This more or less follows the path of ray lectures: each of the ten chap¬ 
ters stands one of the ten lectures, presented in the order in which they 
were delivered.. The first chapter presents a quick overview of different aspects 
of the wavelet transform. It sketches the outlines of a big fresco; subsequent 
chapters then fill in more detail. From there on, we proceed to the continu¬ 
ous wavelet transform (Chapter 2; with a short review of bandlimited functions 
and Shannon’s theorem), to discrete but redundant wavelet transforms (frames; 
Chapter 3) and to a general discussion of time-frequency density and the possible 
existence of orthonormal basis (Chapter 4). Many of the results in Chapters 2-4 
be formulated for the v/indowed Fourier transform as well as the wavelet 
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transform, and the two cases are presented in parallel, with analogies and differ- 
'ences pointed out as we go aJong. The remaining chapters all focus on orthonor¬ 
mal bases of wavelets, rnultiresolution analysis and a first general strategy for 
the construction of orthonormal wavelet bases (Chapter 5), orthonormal bases 
of compactly supported wavelets and their link to subband coding (Chapter 6), 
sharp regularity estimates for these wavelet bases (Chapter 7), symmetry for 
compactly supported wavelet bases (Chapter 8) Chapter 9 shows that orthonor- 
mal bases are “good” bases for many functional spaces where Fourier methods 
are not well adapted. This chapter is the most mathematical of the whole book; 
most of its material is not connected to the applications discussed in other ch^> 
ters，so that it can be skipped by readers'uninterested in this aspect of wavelet 
theory. I included it for several reasons ： the kind of estimates used In the proof 
are very important for harmonic 汹 alysis，and similar (but more complicated) 
estimates in the proof of the theorem of David £md Journe have turned 

out to be the groundwork for the applications to numerical analysis in the wc^rk 
of Beylkin, Coifrnan, and Rokhlin (1991) Moreover, the Calderon-ZygmuSftd 
theorem, explained in this chapter, illustrates how techniques using differdftt 
scales, one of the forerunners of wavelets, were used in harmonic analysis 
before the advent of wavelets. Finally, Chapter 10 sketches several extensions 
of the constructions of orthononnal wavelet bases: to more than one dimensk^ 
to dilation factors different from two (even noninteger), with the possibility 
better frequency localization, and to wavelet bases on a finite interval mstelid 
of the whole line. Every chapter concludes with a section of numbered “Notes,” 
referred to in the text of the chapter by superscript nurhbers. These contain 
additional refereoces, extra proofs excised to keep the text flowing, remarks, etc. 

一 This book is a mathematics book: it states and proves ms^iy theorems. It 
also presupposes some mathematical background. In particular, I assume that 
the reader is familiar with the basic properties of the Fourier transform and 
Fourier series. I also use some basic theorems of measure and integration theory 
(Fatou’s lemma, dominated convergence theorem, Pubini’s theorem; these 
be found in any good book on real analysis). In same chapters, familiarity witb 
basic Hilbert space techniques is useful. A list of the basic notions and theorem^ 
used in the book is given in the Preliminaries. 

The reader who finds that he or she does not know all of these prerequisites 
should not be dismayed, however; mast of the book can be followed witfijust the 
.basic notions of Fourier analysis. Moreover, I have tried to keep a i&ty pedes¬ 
trian pace in almost all the proofs, at the risk of boring some Imathematically 
sophisticated readers. I hope therefore that these lecture notes ivill interest peo¬ 
ple other than mathematicians. For this reason I have often shied away from 
the “Definition-Lemma-Proposition—Theorem Corollary” sequence, and I have 
tried to be intuitive in many places, even if this meant that the exposition be* 
came lew succinct. I hope to succeed in sharing with my readers some of the 
excitement that this interdisciplinary subject has brought into my scientific life. 

I want to take this opportunity to express my gratitude to the many people 
who made the Lowell conference happen: the CBMS board, and the^Mathematics 
Departm^it of the University of Lowell, in particular Professors G. Ksuser and 
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M. B. Ruskai. The success of the conference, which unexpectedly turned out to 
have many more particip^its than customary for CBMS conferences, was due in 
large part to its very efficient organization. As experienced conference organizer 
I. M. James (1991) says, “every conference is mainly due to the efforts of a 
single individual who does almost all the work ”； for the 1990 Wavelet CBMS 
conference, this individual was Mary B#th Ruskai. I am especially grateful to 
her for proposing the conference in the first place, for organizing it in such 
a way that I had a minimal paperwork load, while keeping me posted about 
all the developments, and for generally tbe organizational backbone, no 

small task. Prior to the conference I had tibe ojq>ortunity to teach much of this 
material as a graduate course in the Mathe^iatlGS Department of th 亏 University 
of Michigan’ in Ann Arbor. My one-term visit tfeere was supported jointly by 
a Visiting Professorahip for Women from the Naiioiial Science Foundation, and 
by the University of Michigan. I would like to Ui 篇由 both institutions for their 
support. I would also like to thank aJl the facul 给 md students who sat in on 
the course, and who provided feedback and useful suggestions. The manuscript 
was typeset by Martina Sharp, who I thank for her patience and diligence, and 
for doing a wonderful job. I wouldn’t even 私 ave attempted to write this book 
without her. I am grateful to Jeff Lagarias for editorial comments. Several people 
helped me spot typos in the galley proofs，and I am grateful to all of them; I 
would like to thank especially Pascal Auscher, Gerry Kaiser, Ming-Jun Lai, and 
Martin Vetterli. Atl remaining mistakes are of course my responsiblity. I also 
would like to thank Jim Driscoll and Sharon Murrel for helping me prepare the 
author index. Finally, I want to thank my husband Robert Calderbank for being 
extremely supportive and committed to our two-career-track with family, even 
though it occasionally means that he as well as I prove a few theorems less. 


Ingrid Daubechies 
AT&T Bell Laboratories 
and 

Rutgers University 


In this second printing several minor mistakes and many typographical errors 
have been corrected. I am grateful to everybody who helped me to spot them. 
I have also updated a few things: some of the previously unpublished references 
have appeared and some of the problems that were listed as open have been 
S6lved. I have made no attempt to indude the many other interesting papers 
on wavelets that have appeared since the first printing; in any case, the list 
of references was not and is still not meant as a complete bibliography of the 
subject. 


Ingrid Daubechies, Sept. 1992 
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This preliminary chapter fixes notation conventions and normalizations. It ^so 
states some basic theorems that will be used later in the book. For those less 
familiar with Hilbert and Banach spaces, it contains a very brief primer. (Hiis 
primer should be used mainly as » reference, to corfae back to in those instances 
when the reader comes across some Hilbert or Banach space language that ^ie 
or he is unfamiliar with. For most chapters, these concepts are not used.) 

Let us start by some notation conventions. For : r € R, we write [xj for the 
largest integer not exceeding x, 

[x] = max {n €Z; n < x}. 

For example, [3/2J = 1, [-3/2J = -2, [-2j = -2. Similarly, \x\ is the smallest 
integer which is larger than or equal to x* 

If a—*0 (or oc), then we denote by O(a) any quantity that is bounded by a 
constant times a, by o(a) any qu^itity that tends to 0 (or oo) when a doea 
The end of a proof is always marked with a ■; for clarity, many remarks or 
examples are ended with a □. 

In many proofs, C denotes a “generic” constant, which need not ha 殊 
the same value throughout the proof. In chains of inequalities, I often use 
C 、 C’ 、 C " 、 • ‘ or C u C 2 、 (h 、 … to avoid confusion. 

We use the following convention for the Fourier transform (in one dimension): 

= 去 fjx e-^m . ^ ( 0 . 0 . 1 ) 

With this normalization, one has 

11/ii^ = m ’ 
i/«)i < (^r 1 / 2 11/ii^, 

where 

T i/p 

dx |/(x)|P 



II/IUp = 


xi 


( 0 . 0 . 2 ) 
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Inversion of the Fourier transform is then given by 


/Or 卜 = (TfY{x ), 

g {^) -合(—小 


(0.0.3) 


Strictly speaking, (0.0.1), (0.0.3) are well defined only if /, respectively f/，are 
absolutely iutegrable; for general L 2 -functions /, e.g., we should define Tf via 
a limiting process (see also below). We will implicitly assume that* the adequate 
limiting process is used in all cases, and write v with a, convenient abuse of no¬ 
tation, formulas similar to (0.0.1) and (0.0.3) even when a limiting process is 
understood. 

A standard property of the Fourier transform is: 


( 覆 )， 

hence 

Jdx\f ( \x)\ 2 < oo ^ / 炎 W 2/ i/(0| 2 < oo , 

with the notation =? ^rf- ' 

If a function / is compactly supported, i.e., f(x) = 6 if x < a or x > 6, 
where -oo < a < 6 < do, then its Fourier transform /(《）is well defined also for 
complex 之 ， -and 


1/(01 < ㈣- 1/2 fdx e< Im ^ |/(x)| 

J a 


< 


㈣-" 2 I|/IU» 


j € b (lm€) 
I e « (*n» 4) 


if Im ^ > 0 
if Im ^ < 0 . 


If / is moreover infinitely differentiable, then the same argument can be applied 
to / ⑷， leading to bounds on |/(《)|. For a C°° function / with support [a, b] 
there exist therefore constants so that the analytic extension of the Fourier 
transform of / satisfies 


咖抑 ㈣ ir"{:!=;; _) 

Conversely, any entire function which satisfies bounds of the type (0.0.4) for all 
^ € N is the analytic extension of the Fourier transform of a C°° function with 
support in [a, 6]. This is the Paley-Wiener theorem. 

We will occasionally encounter (tempered) distributions. These are linear 
maps T from the set 5(R) (consisting of all C°° functions that decay faster than 
any negative power (1 + |j;|)—") to C，such that for all m，n € N，there exists 
for which 

|T(/)| < C n , m sup |(l + lx|r / (m) (^)l 

Vtk * 
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holds, for all / G »$(R) The set of all such distributions is called ^(R). Any 
polynomialiy bounded function F can be interpreted as a distribution, with 
F(f) J dx F(x) f(x). Another example is the socalJed “卜 function” of Dirac, 
6(f) = /(0). A distribution T is said to be supported in [a, 6] if T(f) = 0 for 
all functions / the support of whicn has empty intersection with [a, b). One can 
define the Fourier transform TT or T* of a distribution T by T(f) — T(f) (if 
T is a function, then this coincides with our earlier definition). There exists a 
version of the Paley-Wiener theorem for distributions: an entire function T(4) 
is the analytic extension of the Fourier transform of a distribution T in 5 # (R) 
supported in [a, b] if and only if, for some N G N, > 0, 


\f(o\<c N (i^\(\) N 


ImC>0 
Im ^ < 0 . 


The only measure we will use is Lebesgue measure, on R and R rt . We will 
often denote the (Lebesgue) measure of S by j5|; in particular, |[a,6]j = 6 — a 
(where b > a). / 

Well-known theorems from measure and integration theory which we will use 
include 

Fatou’s lemma. If /„ > 0, f n (x) 一 f(x) almost everywhere the set 
of points where potntmse convergence, fails has zero measure with respect to 
Lebesgue measure), then 

/ dx f(x) < li 瓜 sup / dx.f n (x). 

n—+oo J * 

In particular, if this lim sup is finite, then f ts mte^rable. ， 

(The lim sup of a sequence is defined by 

liiasup a n = lim [sup {a *； ^ > «}]； 

n—oo n—oo 

every sequence, even if it does not have a limit (such as a n — (-l) n ), has a 
lim sup (which may be oo); for sequences that converge to a limit, the lim sup 
coincides with the limit.) 

Dominated convergence theorem. Suppose f n [x) —* j(x) almost every¬ 
where. If |/ n (x)| < g(x) for all n, and J dx g(x) < oo, then f is integrable, 

f dx f(x) = lim / cfcc f n (x ). 


Fabini’s theorem. If f dx[f dy |/(x,y)|] < oo, then 


J dx J dy f(x,y) = j dx J dy f(x,y) 

=[dy f dx f(x， V ) 
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i.€. f the order of the miegrations can be permuted. 

In these three theorems the domain of integration can be any measun 
subset of R (or R 2 for Fubini). 

When Hilbert spaces are used, they are usually denoted by H y unlm t 
already have a name. We will follow the mathematician’s convention and 
scalar products which are linear in the first argument ： 

(AiUi +A 2 u 2 , u) - Ai{ui, u) -f A 2 (ii2, v), 

Ab usual, we have _ 

<v,ix) = (ii~u), 

where q denotes the complex conjugate of a, and (ti,u) > 0 for adl u G 
define the norm |)u|| of u by ' 

\\uf =<«,«> . (0 

In a Hilbert space, ||u|| = 0 implies « = 0, and all Cauchy ^quences ( 
respect to || II) have limits within the space. (More explicitly, ii u n £H a. 
||u„ - u m || becomes arbitrarily sm^ll if n, m are large enough — i.e.，for all e 
there exists uq, depending on e, so that ||w n — w m || < c if «, > «o—, then i 

exists n € K so that the u n tend to u for n—oo, i.e” lim n _oo ||u - tt n |f = 

A standard example of such a Hilbert space is L 2 (R), with 

if, 9) = J dx 硕 . 

Here the integration runs from 一 oo to oo ； we will often drop the integr 
bounds when the integral runs over the whole real line. 

Another example is i 2 (Z), the set of all square summable sequences of 
plex numbers indexed by integers, with 

OO 

(c, d) — > : q d n • ‘ 


Again, we will often drop the limits on the summation index when w 
over all integers. Both Z< 2 (R) and £ 2 (Z) are infinite'dimensional Hilbert 
Even simpler are finite-dimensional Hilbert spaces，of which C* is the sta 
example, with the scalar product 


(tx.t;) =5^ Uj Vj , 

for w = ( 1 * 1 , …, tijt )，v - (vir-,Vk) 6 C*. 

Hilbert spaces always have orthonormal base 


i, i.e” there exist fami 


and 


( e m e m) ― ^n,m 

w 2 = E I ㈣ i: 
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for all u e H. (We only consider separable Hilbert spaces, i.e., spaces in which 
orthonormal bases are countable.) Examples of orthonormal basesWe the Her- 
mite functions in L 2 (R), the sequences e n defined by (e rt )j = b n '” ^ith n, j € Z 
in £ 2 (Z) (i.e., all entries but the nth vanish), or the k v 沈 tors e 1} • • • ,ejt in C k 
defined by (e^) m = with 1 < £, m < k. (We use Kronecker’s symbol 6 with 
the usual meaning: 6 t ,j = 1 if i = j, 0 if« ^ >.) 

A stmidard inequality in a Hilbert space is the Cauchy-Schwarz inequality, 


K^^>l < ll^ll Ikll * (0-0.6). 

easily proved by writing (0.0.5) for appropriate linear combinations bf v and w. 
In particular, for f 、 g€ L 2 (R}, we have ’ 

J dx f(x)^(x) < (^J dx |/(x)| 2 )" 2 O l*” 2 ) 1 ’ 2 ，' 
and for c - (cn) ne z, d- (rf n )„ e x e ^(Z) t 

' w 2 ) l/2 (e ki 2 

A consequence of (0 0.6) is 

||u|| = sup |(w ， v〉| = sup |{ti,v)| . (0.0.7) 

W, l|u||<l v, |[v||=l 

〆 

“Operators” on are linear maps from H to another Hilbert space, often H 
itself. Explicitly, if A is an operator on then 

+ A 2 U 2 ) — Aij4ui 4" A2^1ti2 - 



An operator is continuous if Au — Av can be made arbitrarily small by making 
u - v small. Explicitly, for all e > 0 there should exist 8 (depending on e) so 
that \\u - v|| < ^ implies ||Aii - Av^ < e. If we take v = 0, € — 1, then we 
find tfiat, for some 6 > 0, [lv4w|| < 1 if ||u|| < b. For any w & H we can define 
w r = clearly H^H < b and therefore - ^ < 6~ 1 ||ti;||. If 

||i4u»||/|[iy|| (w / 0) is bounded, then the operator A is called bounded. We have 
just seen that any continuous operator is bounded; the reverse is also true.- The 
norm ||^1|| of ^4 is defined by 

j|j4[| = sup ||j4«||/||u|| — sup ||i4u|| . (0.0.8) 

new, IMI/o ll«!l=i 

It immediately follows that, for all ti € W, 

^ \\Au\\ < MU ||«|| . 

Operators from 7i C axe called “linear functionals.” For bounded linear 
functionals one has Riesz’ representation theorem: for any l: H~*C, linear and 
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bounded, i.c*, |£{w)| < C||u|J for all u € K, there exists a unique vg bo that 
i(u) = {u,v f ). ’ 

An operator U from Tii to H 2 is an isometry if (Uv,l/w) = (v t w) for ail 
v,w U is unitary if moreover UH\ — 尺 2 , i e., every element 的 € ^2 can 

be written as V2 — VD\ for some V\ 6 H\. If the e n constitute an orthonormal 
basis in 7i u and U is unitary, then the Ue n constitute an orthonormal basis in 
7^2 - The reverse is also true- any operator that maps an orthonormal basis to 
another orthonormal basis is unitary. 

A sot D is called dense in H if every u e H can be written as the limit of 
some sequence of u n in D. (One then says that the closure of D is all of H. The 
closure of a set S is obtained by adding to it all the v that can be obtained as 
1 ㈣ ts of sequences in S.) If Av is only defined for v e D, but we know that 


||/it;|| < C||v|| foralh;6 O, (0.0 9) 


then wa can extend A to all of H tl by continuity. n Explicitly: if tt e find 
u n 6 so that u n = u. Then the u n are necessariJy a Cauchy sequence, 

and because of (0.0.9), so are the Au n ; the Au n hav 合 therefore a limit, which we 
call Au (it does not depend on the particular sequence u n that was chosen). 

One can also deal with unbounded operators, i.e., A for which there exists 
no finite C such that ||4ii|| < C||u|| holds for all u €H. It is a fact of life that 
these can usually only be defined on a dense set D in and canndt be extended 
by the above trick (since they are not continuous). An example is ^ in X 2 (R), 
where we can take D — Co°(IR)r the set of all infinitely differentiable functions 
with compact support, for D. The dense set on which the operator is defined is 
called its domain. 

Ine adjoint A* of a bounded operator A from a Hilbert space Tit to a Hilbert 
space H 2 (which may be H\ itself) is the operator from H 2 to H\ defined by 


{u u A*u 2 ) = (Aui,u 2 ), 

which should hold for all U\ € Hi, u 2 ^ H 2 - (The existence of >1* is guaranteed 
by Riesz 5 representation theorem: for fixed « 2 , we can define a linear functional 
i on Hi by t(u\) = {Au\ y U 2 ). It is clearly bounded, and corresponds therefore 
to a vector v so that = i(u). It is easy to check that the correspondence 

U 2 ~^v is linear; this defines the operator j 4*.) One has 

PI - W ， 卜 I 岡 2 . 

# 

\i A* ~ A (only possible if A maps 7i to itself), then A is called self-adjoint. If 
a self-adjoint operator A satisfies {Au, u) > 0 for all u € H, then it is'called a 
positive operator; this is often denoted A > 0. We will write A> B if'v4 ~ B is 
a positive operator. 

TVace-class operators are special operators such that |(j4e„,f n )| is finite 
for all orthonormal bases in H. For such a trace-class operator, (Ae n ^ c n ) is 
independent of the chosen orthonormal basis; we call this sura the trace of A 1 

ti A — : (j4e n ,e n ), 
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If A is positive, then it is sufficient to check whether Y^ n (-^e n ,e n ) is finite for 
only one orthonormal basis; if it is, then A is trace-class (This is not true for 
non-positive operators!) 

The spectrum^ cr(v4) of an operator A from H to itself consists of ail the 
A 6 C such that v4 —入 Id (Id stands for the identity operator, Idu = u) does 
not have^a bounded inverse. In a finite-dimensional Hilbert space, a{A) consists 
of the eigenvalues of >1; in ti^e infinite-dimensional case, o(A) contams all the 
eigenvalues (constituting the point spectrum) but often contains other A as well, 
constituting the continuous spectrum. (For instance, in t 2 {R) f multiplication of 
f{x) with sih nx has no point spectrum, but its continuous fipecttum is [-1,1]) 
The spectrum of a self-adjoint operator consists of only real numbers; the spec¬ 
trum of a positive operator contains only non-negative numbers. The spectral 
radius fi{A) is defined by ' 


p(A) ~ sup {jAj , 入 G a(^4)}. . 

It has the properties " 

p(^)< ||^(| and p(A)= hm j|^t[ ,/n • 

n —oo 

Self-adjoint operators can be diagonalized. This is easiest to understand if 
their spectmm consists only of eigenvalues (as is the case in finite dimensions). 
One then has 

= {A n ; n € N}, 

with a corresponding orthonormal family of eigenvectors, 

= A n c n . ' 

It then follows that, for all u e H, 

(Au y e n )e n - ^ (u, Ae n )e n ~^X n (u,e n )e n , 

n n n 

which is the ^diagonalization 51 of A. (The spectral theorem permits us to gen¬ 
eralize this if part (or all) of the spectrum is continuous, but we will not need it 
in this book.) If two operators commute, i.e., ABu — BAu for all u € W, th^n 
they can be diagonalized simultaneously: there exists an orthonormal basis such 
that 

Ae„ = a„e n and Be n = 0 n e n . 

Many of these properties for bounded operators can also be formulated for un¬ 
bounded operators: adjoints, spectrum, diagonalization all exist for unbounded 
operators as well. One has to be very careful with domains, however. For in- 
stance t generalizing the simultaneous diagonalization of commuting operators 
requires a careful definition of commuting operators: there exist pathological 
examples where B are both defined on a domain £>, where AB and BA both 
make sense on D and are eqvial on D y but where A and B nevertheless are not 
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simultaneously diagonalizable (because D was ehosen “too small” ； see, i 
and Simon (1971) for an example). The proper definition of commuti] 
bounded self-adjoint operafcoi'S uses associated bounded operators ： H 
commute if their associated unitary evolution operators commute. I 
adjoint operator H, the associated unitary evolution operators U t are 
follows: for* any v 6 D t the domain of H (beware: the domain of a s< 
operator is not just any dense set on which H is well defined), Utv is th 
v(t) at_time t = T of the differential equation 

ij t Ht) = Hv(t) , 

with initial condition v(0) — v. 

Banach spaces share many properties with but are more general th 
spaces, They axe linear spaces equipped with a norm (which need n 
generally is not derived from a scalar product), complete with respe 
norm (i.e., all Cauchy sequences converge; see above). Some of th< 
we reviewed above for Hilbert spaces also exist m Banach spaces; e.g 
operators, linear functionals, Spectrum and spectral radius. An exi 
Banach spf^ce that is not a space is the set of all functii 

such that W/Wlp (see (0,0.2)) is finite, with 1 < p < oo, p ^ 2. Anothi 
is L°°{R) t the set of all bounded functions on with = 5 sup 2 

The dual E* of a Banach space E is the set of all bounded linear 
on it is also a linear space, which comes with a natural norm (d« 
(0.0.7)), with respect to which it is complete ： E* is a Banach space it 
case of the Ir-spaces y 1 < p < c», it tun® out that elements of L Q , w 
q are related by p~ l +g _1 - 1, define bounded linear fiinctionals on J 
one has Holder's inequality, 

j dx f(x) g^c) < ||/|Up ||p|U« . 

It turns out that all bounded linear functionals on D* are of this 
(L^Y = L q . In particular, L 2 is its own dual; by Riesz’ representati* 
(see above), every Hilbert space is its own dual. The adjoint A* of i 
A from Ei to E 2 is now an operator from B 2 to E\ y defined by 

(A*£ 2 )(v l )^e 2 (Av l ). 

There exist different types of bases in Baiiadi spaces. (We will 
consider separable spaces, in which bases are countable.) The 
tute a Schauder basis if, for all u € K, there exist unique /i n 6 
V = limjv —00 En=i (i.e” ||v - J2n=,i MnenHO as 00 ). The 
requirement of the /i n forces the e n to be linearly independent, in tb 
po en can be in the closure of the linear span of all the others, i.e” th 
7m so that e„ = Um JV _ <so m/n 7m€ m - In a Schauder basis, 1 

of the e n may be important. 'A basis is called unconditional if in 
satisfies one of the following two equivalent properties: 



The What ， Why, and How of 
Wavelets 


The wavelet transform is a tool tliat cuts up data or functions or 'operators into 
different frequency components, and tht»n studies each component wilh a resolu¬ 
tion matdied to its scale. Forerunners of this teduiique w<tc indepen¬ 

dently in pure mathematics (Calderon'n resolution of the identity in harmonic 
analysis see e g., Calderon (1964)), physics (cohereut states for the («j’ 十 6)- 
group in quantum mechanics, first constructed by Aslaksm and KlamlcT (1968), 
and linked to the hydrogen atom HanlilIonian by Paul (19H5)) aiu] rrigiiioering 
(QMF filters by Esteban and Galland (1977), and later QMF filter* with exact 
reconstruction property by Smith and Darnwell (1986), VcjttiTli (1986) in (elec¬ 
trical engineering; wavelets were proposed for tlu* analysis of seismic data by 
J. Morkt (r983)). Tlie last five years have seen a synthesis hciwt't'ii all these 
different approaches, which has been very fcrtik* for all the fields c*oiircrnt*{l. 

Let ua stay for a moment within the signal Analysis framework. (The dis¬ 
cussion can easily be translated to other fields,) The wavt'lct transform of a 
^igrial evolving in time (e.g., the amplitude or the pressure ou an eardrum, for 
acoustical applications) depends on two variables: scale (or frequency) and time; 
wavelets provide a tool for time-frequency localization. The first section tclfe us 
what time-frequency localization means and why it of inUToai. The remaining 
sectiohs describe different types of wavelets. 

1.1. Time-frequency localization. 

In many applications, gi^en a signal f(t) (for the moment, wo assume that 
t is a continuous variable), one is interested in its frequency content locally in 
time. T^iisas similar to music notation, for example, which tells the player which 
notes (= fr^queiwy information) to play at any given moment. The standard 
Fourier transform, ^ 

( ， /)(o;), 去 fdte-^m, 

also gives a representation of the frequency content of /, but information con¬ 
cerning time-localization of, e.g.^ high frequency bursts cannot be read off easily 
from /. Time-localization can be achieved by firat windowing the signal /’ so 
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as to cut off only a well-localized slice of /, and then taking its Fourier transform: 

(7 ^/)(〜） ^ jds f(s) g(s - t)e~^ . (1.1.1) 

This is the windowed Fourier transform, which is a standard technique for time- 
frequency localization. 1 It is even more familiar to signal analysts in its discrete 
version, where t and u are assigned regularly spaced values: t = a; = mujQ, 
whore m,n range over Z, Mid a/o, to > 0 are fixed. Then (1.1,1) becomes 

^m ： n(/)- Jdsf(s) g(s~nt {} ) 。， . (1-1-2) 

This procedure is scliematicaliy represented in Figure LI: for fixed n, the 
^m!n(/) correspond to the Fourier coefficients of /(- )^( - - ni。）. If，for instance, 
g is compactly supported, thon it is dear that, with’appropriately chosen u ;。， 
the Fourier coefficients T^[ n (/) arj? sufficient to characterize and, if need be, 
to reconstruct /(*) 夕 (—— nto)- Changing n amounts to shifting the “slices” by 
steps af and its multiples, allowing the recovery of all of / from the 
(We will discuss this in more ttiathematical detail in Chapter 3.) Many possible 
choices have bren proposed for the window function g in signal analysis, most 
of which have compact sitpport and reasonable smoothness. In physics, (1.1.1) 
is related to coherent state representations; the g u,t (s) = e tu,!t g{s — t) are the 
coherent states associated to the Wcyl -Heisenberg group (see, e.g., Klauder and 
Skagerstam (1985)). In this context, a very popular choice is a Gaussian g. In all 
applications, g is supposed to be well concentrated in both time and frequency; if 
g and g are both concentrate! around zero, then (T wm /)(u;, t) can be interpreted 
loosely as the u content w of / near time t and near frequency u). The windowed 
Fourier transform provides thus a description of / in the time-frequency plane. 





Fig. 1.1 The wtndowed Founer 
function g(t), and the Founer coeffh 
ts then repeated for transUUed verstc 


n ； the function f(t) is midtipUtd with the window 
the product f(t)g{t) are computed; the procedure 
r twndoto, g(t — to), g(t — 2fo), - - 
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1.2. The wavelet transform: Analogies and differences with the 
windowed Fourier transform. 


The wavelet transform provides a similar time-frequency description, with a 
few important differences. The wavelet transform formulas analogous to (1 1 1) 
and (1.1.2) are 

^ ( 7 —/)(«^)- Jdtf(t)^ (^) ( 1 . 2 . 1 ) 

^ ^ 1 

and 

TZ%(f) = a 0 " m/2 dtf(t) (1.2.2) 

Io ^g^ti qBses we assume that 畛 satisfies 

Jdt^(t) = 0 (1.2.3) 


(for reasons explained in Chapters 2 and 3). 

Formula (1.2 2) is again obtained from (1.2.1) by restricting a, 6 to only dis¬ 
crete values: a = a^ 1 , b — nbad^ in this case, with m,n ranging over Z, and 
oo > 1, 6o > 0 fixed. One similarity between the wavelet and windowed Fourier 
transforms is clear ： both (1.L1) and (1.2.1) take the inner products of / with a 
family of functions indexed by two labels, <**(3) = ^ a g(s - t) in (1.1.1), and 
i> a,b (s) — |aj~" 2 in (1.2 1). The functions are called ^wavelets”; 

the function ^ is sometimes called “mother wavelet,” (Note that 分 and g are 
implicitly assumed to be real, even though this is by no means essential; if they 
are not, then complex conjugates have to be introduced in (1.1.1), (1.2.1).) A 
typical choice for ip is tf>(t) = (1 - t 2 ) exp(—f 2 /2), the second derivative of the 


Gaussian, sometimes called the mexican hat function because it resembles a cross 
section of a Mexican hat. The mexican hat function is well localized in both time 
“and frequency, and satisfies (1.2.3). As a changes, the xp a,0 (s) = \a\~ l ^ 2t tj?(s/a) 
、 pover different frequency ranges (large values of the scaling parameter |a| cor- 
$ 警學 》ond to small frequencies, or large scale d small values of |o| correspond 
frequencies or very fine scale 矽 a,0 ). Changing the parameter b as well 
us to move the time localization center ： each ip a,b (s) is localized around 
9 follows that (1.2.1), like (1.1.1), provides a time-frequency descriptipn 

of 奴 difference between the wavelet and windowed Fourier transforms lies 
of the analyzing functions and ^ a,b , as shown in Figure 1.2. 
The all consist of the same envelope function g, translated to the 

proper and “filled in” with higher frequency oscillations. All the 

9 Wt » the value of have the same width. In contrast, the if) a,b have 

time-widt%^^ed to their frequency: high frequency ip a,b are very narrow, 
while low fireq^^jr xp a>b axe much broader^ As a result, the wavelet transform 
is better able tlUMd^the windowed Fourier transform to “zoom in” on very short¬ 
lived high fre^ue&cy phenomena, such as transients in 3 ignals (or singularities 
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FlC 12 7^pirai sftapea o/ (a) totndowed Founer transform, functions and 

(b) ivavelets i/j a,b The — e^ ltax g{x - t) can be viewed as translated envelopes g, 

“fitted »n” with higher frequencies the 於 b are alt copies of the same functions, translated 
and compressed or stretched 


in functions or integral kernels) This is illustrated by Figure 1 3, which shows 
windowed Fourier transforms and the wavelet transform of the same signal / 
defined by 

" f\t) — sin(2iri/it) 4 - sin(27ri/2t) + - t x ) + 6{t - tj)]. ’ 

In practice, this signal is not given by this continuous expression, but by samples, 
and adding a ^-function is then approximated by adding a constant to one sample 
only. In sampled version, we have then 、 

f{nr) - sin(2^i?tr) + sin(27rt ⑽ t) + + ^ n ,n 2 ]. 

For the example in Figure 1.3a, v x = 500 Hz, ^2 = 1 kHz, t = 1/8,000 sec (i.e” 
we have 8,000 samples per second), a — 1.5, and n 2 ~ = 32 (cortesponding 

to 4 milliseconds between the two pulses). The three spectrograms (graphs of 
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the modulus of the windowed Fourier transform) in Figure 1.3b use standard 
Hamming windows, with widths 12.8, 6.4，、and 3.2 milliseconds, respectively. 
(Time t varies horizontally, frequency u> vertically, on these plots; the grey levels 
indicate the value of |T win (/)|，with black standing for the highest value.) As 
the window width increases, the resolution of the two pure tones gets better, 
but it becomes harder or even impossible to resolve the two pulses. Figure 1.3c 
shows the modulus of the wavelet transform of / computed by means of the 
(complex) Morlet wavelet ^p(t) = C e~ t3 (e xnt - e ~ 霄 w jth a = 4 - (To 
make comparison with the spectrograms easier, a linear frequency axis has been 
used here; for wavelet transforms, a logarithmic frequency axis is more usual.) 
One already sees that the two impulses are resolved even better than with the 
3,2 msec Hamming window (right in Figure 1.3b) t while the frequency resolu¬ 
tion for the two pure tones is comparable with that obtained with the 6.4 msec 
Hamming window (middle in Figure 1.3b). This comparison of frequency resplu- 
tions is illustrated more clearly by Figure 1.3d ： here sections of the spectrograms 
(i.e.，plots of |(T' wlI1 /)(.，01 with fixed t) and of the wavelet transform modulus 
(l(T ， wlkV /)(-,b)j with fixed 6) are compared. The dynamic range (ratio between 
the maxima and the “dip” between the two peaks) of the wavelet transform is 
comparable to that of the 6.4 msec spectrogram. (Note that the flat horizontal 
“tail” for the wavelet transform in the graphs in Figure 1.3d is an artifact of 
the plotting package used, which set a rather high cut-off, as compared with the 
spectrogram plots; anyway, this cut-off is already at —24 dB.) 

In fact, oui>ear uses a wavelet transform when analyzing sound, at least in 
the very first stage. The pressure amplitude oscillations are transmitted from 
the eardrum to the basilar membrane, which extends over the whole length of 
the cochlea. The cochlea is rolled up as a spiral inside our inner ear; imagine it 
unrolled to a straight segment, so that the basilar membrane is also stretched 
out. We can then introduce a coordinate y along this segment. Experiment aad 
numerical simulation show thkt a pressure wave which is a pure tone, = 

leads to a response excitation along the basilar membrane which has the 
same frequency in time, but with an envelope in y, Fu,(t,y) — e Mt <Aw(y)* a 
first approximation, which turns out to be pretty good for frequencies w above 
500 Hz, the dependence on u of <^ w (y) corresponds to a shift by log un there exists 
one function 0 so that 4>u>{y) is very close to (j>(y ~\og u). For a general excitation 
function /, f(t) — f du) it follows that the response function F(t,y) 

is given by the corresponding superposition of “elementary response functions，” 

nt.y) = /M FUt.y) 




/(w) e Mt 4>(y - Jog ui ). 


If we now introduce a change of parameterization, by definii^ 


^{c~ x ) = (2?r)" 1/2 ^(x), log a), 



then it fellows that 
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/ G(aj) = J dt f /(^) ,P(a(t - t f )), 

^liich (up to normalization) is exactly a wavelet transform. The dilation param¬ 
eter come&in, of course, because of the logarithmic shifts in frequency in the 
yhe occurrence of the wavelet transform in the first stage of our own biological 
acoustical analysis suggests that wavelet-based methods for acoustical analysis 
l\ have a better chance than other methods to lead, e.g., to compression schemes 
1 地 detectable by our ear. 

I Different types of wavelet transform. 

、 * 
^ ^there exist many different types of wavelet transform, all starting from the 
bame.ibrmulas (1.2.1)，（1 2.2). In these notes we will distinguish between 

A. 犧 e continuous wavelet transform (1.2.1), and 

,r “ 

B The discrete wavelet transform (1.2.2). 

^ ^ 1 

Within the discrete wavelet transform we distinguish further between 
Bl. Redundant discrete systems (frames) and 
B2. OrtJionormal (and other) bases of wavelets. ' 

1,3,1， The continuous wavelet transform. Here the dilation and trans*, 
lation parameters a, b vary continuously over R (with the constraint a ^ 0). The 
<^velet transforni is given by formula (1.2.1); a function can be reconstructed 
from its wavelet transform by means of thfe “resolution of identity” formula 

心 ‘ - f-c^r r ^ (f ， r， b )_, d.3.1) 

J — oo J -oo ^ 

^where ip a>b (x) = |a|—" 2 嗲 (^) t and ( , ) denotes the L 2 -inner product. The 
^^^onstant depends only on ip and is given by 


炎 m )\ 2 icr 1 ； 


< oo (otherwise (1.3.1) does not make sense). If ^ is in L J (R) 
謂 is the case in all examples of practical interest), then ^ is continuous, so 
can be Unite only if ^(0) = 0, i.e., / dx ip(x) — 0. A proof for (1*3.1) 
,given in Chapter 2. (Note that we have implicitly assumed that 畛 is real; 

we should use ^ instead of ^ in (1.2.1). In some applications, 
®^'<somplex tff are useful.) - ' 

為: __aula (1.3.1) can be viewed in two different ways: (1) as a way of re- 
CfeA^ucting / once its wavelet transform is known, or (2) as a way to 
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write / as a superposition t)f wawk'ts 4 >u ' b \ tht> rodHriciits in this superpositi(Mi 
are exactly given hy the wavrict traiisftjrrn of /. Both pointy of view iead to 
interesting applications. - 

The correspoiuh'nccj f(s) -■* [ r i' wav f)(a, b) n'pr(*s<Mit..s a om?-variable function 
by ii function of two vnriah!( ； s, iiito which tots of corrdatiotis are built in (see 
Chapter 2). T)iks n'dundancy of tho rfprfscntation can lw i < , xploit(»d;*ji beautiful 
application is the coiiwpt of tiu* “skolrtmi” of a signal, cxtriU'tud from the con¬ 
tinuous wavek't traiiHforiu, which t-an bt* ust'd for nunlinoar HlLering (see, e.g ，， 
Torresani (1991), Duljxrat ot al. (1092)). 

1.3.2. The discrete but redundant wave lot transform-frames. In this 
case the dilation i«iriiim j ter a and Uh* translation paranM'tef Injth tnk(? only 
discreti； values. Pbr a wv rhoost 1 the intrgor (positive and iiegatiw) poweirs of 
one fixed diiation 、1， i.e , a a ( 7 - As (ilr(、atiy il lust rated by 

Figure 1.2, difFtTt'nt values of m corrosiujiuJ to wavcN't.s of difFprent widths. It 
follows that i\w disrn'ti/ation of tin* translution panum'lt'r /) should th;pend on 
m: narrow (high froqurnry) wavrlots art* transbiU'd by smal] str[xs in order to 
cover the whole time raugt 1 , while wider (lower hvqiH'ucy) wavelets an* translated 
by larger steps. Sinct* the width t)f ij>(a u nt x) is proportional tu f" 厂. wc choose 
therefore to dihereti/x* U by h - tif^aU', whore 6 () U is (ixt*d, mul a C. Z. The 
corresponding di.scrctt'ly iaho)l( i (l wavelets an* t,iu'rrft>rt; 

7,(-(') - < h ) m/ ^ ， n ( J ' 叫 )0) 

二 n () m/2 0(a o m .r u/j n ) (1.3.3) 

Figure 1.4a shows schtMiiatically the liittin' ()f tiiiu'-frt'<|U('n< v Inralizat-ion conters 
corresponding to the (*or a given funefeitm /, the iim<‘r products {/,^ m ,n) 

then give exactly the diwrrte wavelet transform T^f/) flcfiiu'd in (1:2 .旬 
(we assume again that V’ k real). 

In tlie dibtrete cast% there doas not exist, in gt'iieral, a ^msointion of the 
identity” formula analosoius to (1,3.1) for tiu* contimious rase. Hct：(instruction 
of / from T wav (f), if at all p (邮 ibl”, must bv doin' l>y soint* ottu;r means. 

The following questions naturally arise ： ^ 

(1) Is it possible to chararttTizii / completely by knowing r wav (/)? 

(2) Is it possible to reconstruct / in a mimcricatly stable way from T WiiV (/)? 

These questions concern the recovery of / from its w<ivelot transform. We can 
also consider the dual problem (see §1.3.1), the possibility of expaudiiig / into 
wavelets, which then leads to the dual qucKtiuiis ： 

(1^) Can any function be written as a Huperpoyition of 分 m ， n ? 

(2’) Is there a numerically stable algorithm to compute the coefficients for such 
an expansion? 

Chapter 3 addresses these questions. As in the contimious case, these discrete 
wavelet transforms often provide a very redundant description of the original 




na9 iwo peons m m me cwc, Csg. f /c 

矽 ⑷ =(1 - t 2 )c~* a / 2 ); |^m.n(OI pea** 土 which ai 
cr® of V*m,n tn /reguency. ⑻ The taindowed Founer transform : 如 
tn time, around ma^i »n freguencj/. 
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fimctkHi. This redundancy can be exploited (it is, for instance, possible to com¬ 
pute the wavelet transform only approidmat^y, while still obtaimi^ reconstruc¬ 
tion of / with good precision), or eliminated to reduce the transform ta,its bare 
essentials (such as in the ima^e compression work ofMailat and Zhong (19^)). It 
is in this discrete form that the wavelet transform is closest to the 
of FVazier and Jawefth (1988)* 

The choice of the wavelet ^ used in the continuous wavelet transform or In 
frames of discretely labelled fooiilies of wavelets is esse^ially only restricted by 
the requirement that as defined t?y (1.3.2), is finite. For practical reasons, 
(me usually chooses iff so that it is well concentrated ia both the time and the 
frequency domain, but this still leaves a lot of freedom. In the next section we 
will see how giving up most of this freedom allows us to build orthonormal bases 
of wavelets. 

1.3«3. Orthonormal wavelet bases ： MultSresolution analysis. For 
^ome very special choices of ^ a^d ao ， &o, the 岭 m ， n constitute an orthonormal 
basis for L 2 (R). In particular, if we choose ao = 2, = l f 2 then there exigt 分， 

with ^©od time-frequency localization properties, such that the 

分卜： r— 2 妒 (2，x — n) (L34) 

constitute an orthonormal 1>asis for L 2 (R). (For the time being, and until Chap-' 
ter 10, we restrict ourselves to flo = 2.) The oldest example of a function ^ for 
which the 岭 m ， n defined by (1.3.4) constitute an orthonormal basis for L 2 (R) is 
the H^ar function, . 

f 1 0<x<J 

v 必 (®) - ^ *-l 5 <ar< 1 . 

. I 0 otherwise. 

The Haar be«is has been known 細 ce Haar (19i0). Note that the Haar func¬ 
tion does not have good time>&etpiency localization: its Fourier transfc»ixi 必 ((） 
decays like | 《卜 1 for 《一 oo. Nevertheless we will use it he>e for illustration 
purposes. What follo^B is a ptwf that the Haar family does indeed constitute 
an orthonormal t^ksis. This proof & different from the one in most textbocdcd; in 
fact, it will use multiresoluticm analysis as a tool. 

In order to prove that the 0 m ,n{®) constitute an orthonormal bads, we need 
to establish that 

(1) the 岭 m ， n are orthonormal; 

(2) any L 2 -ftmctkm /, can he approximated, up to arbitral% small precision, 
fay a finite linear combination of the xfj mt n ， 

Orthonormaiity is easy to establish. Since support 2"*(«+1)1 ， 

it follows that two Hftar wavelets of the same scale (saanM^ value ci m) never 
overlap, da that Overlapping supports m poesibleif the 

two wavelets have different Bizes, as in Figure 1.5. It is easy to dieck, however, 
that if m < m # , then support 版 8 wholly within a region where 珍概 *〆 la 
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ccmstaat (as on the figure). It follows that the Inner product of ^m t n and 
is then proportional to the integral of jff itself, which is zero. 



m an interval 


wavelets, the support of the tt nanvwer” wavelet w completeiy 
re the ^wider 9 wavelet u constant 


Wfr Concentrate now on how well an arbitrary function / can be approximated 
by linear combinations of Haar wavelets. Any / in L 2 (R) can be arbitrarily well 
«|^>raxtmated by a function with compact support which is piecewise constant 
on the (it suffices to take the su 卯 ort and j large enough). We 

can therefore restrict ourselves to such piecewise constant functions only ： assume 
/ to be supported on ( T 2 J, , 2 Jl ] t and to be piecewise constant on the [/ 2 ~ J ° T 
(/+ 1)2~^*I，where J\ and J 0 can both be arbitrarily large (see Figure 1 . 6 ). Let 
_ denote the constant value of /° = / oa (, + 1)2 _J »{ \fy ff. We now 

^e^veent /° asa sum of two pieces, / 0 = 尸 + 妒 ， where / l isan approximation 
wliicb is piecewise constant over intervals twice as large as orig»ally T i<e M 
Jr|p 2 -Jo+»,(fc+i) 2 -- constant = fl. The values fl are g^vm by the aver¬ 
ages ci the two corresponding constant values for /°, fl *= 5 (^* + ^ +1 ) (see 
2 彝 The function is piecewise constant with the same stepwidth as 
、濃 pm iupanediately has 

l ft - - A+i) 


略 +1 = 洛 +i — /i 2(/S?+i _ fu) — Hi - 

It is a linear combination of scaled and transited Haar functions: 

= ^2 ^3eV , (2* / °"" l ar - £) . 

|；5S=->2* ； » +J 0- 1 +l 

We have thm^are w^tteo / as 
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Fia 1 6 (a) A functxon / with support |-2 J, , 2 J, J, piecewise constant on the 
(A: + (b) A blowup of a portion of f On every pair of mtervtUs, f ts replaced by 

tts average (—~* f 1 ); the d 屯 erence between f and } l ts 6 l , a linear combination of Hoar 
wavelets. 


where f l is of the same type as /°, but with stepwidth fctvice as larg^. We can 
apply the same trick to so that 

f l = f 2 + y^C,j 0+ 2,/ ^-J 0 +2,t , - 

t 

with f 2 still supported on [-2* ，1 ,2 J, ] t but piecewise constarit on the-even larger 
intervals [fc2 _Jo+2 , (k + l)2 -Jo+2 [. We can keep going like this^ mitil we have 

m——^/o+l t 

Here f Jo+Jl consists of two constant pieces (see Figure 1.7), with 
/ Jo+ * /l |(o. 2 - , i ( 三 fo 0+Jl equal to the average of / aver [0, 2 Jl [, and 
/ Jo+ * 7l | 卜 2 Ji,o| 主 the average of / over 

Even though' we have “filled out” the whole support of /， we can still Iceep 
going with our averaging trick: nothing stops us from widening our horizon from 



-|f J 1 0 + Jl V(2 J i 、+ 1> + 〜 (2 J i 、） 

i 

> FlG. J.7. The averages of f on [0, 2 Jl ] and [—2 J * t Oj am be "smeared 1 * out over the bigger 
intervals (0, 2^ 1+J ], [—2 Jl+1 , OJ, tfce difference ta a linear combination of very stretched out 
Hoar functums. 


2^* to 2 Jl+1 , and writing f Jl+Ji = / Jl+Ja+1 +^ i/l+Ja+1 , where 

and , 

: (see Figure 1.7). This can again be repeated, leading to 
^ 1 Ji+K 

,f ‘ / = f Jo+Jl+K + 亡 Vw ， 

暴“ m=—Jo+1 t 

，We support (/ Jo+Jl+iC )= 【 -2 Jl+K ， 2 Jl+Jir 】，and 

2-U Jc+Jl ，^ +Jl+JC | t WM = 2~ K fit^ . 

1$ 诚 lipg ^mediately that 

■V St 破秦敛 


/- B Ew 。 

t 


\\f Jo+Ji+K \\h 


2-K/2 •2 』 i/ 2 [jy^o+Ap + |^o+Ji |2jl/2 


vhich can b4 f ii^e arbitrarily small by taking sufficiently large K. As claimed, 
/ c*u> therefore ||»prc»diiiated to arbitraiy precision by a finite linear combi¬ 
nation of Haar waV^s! 

l*he argument we just saw has im^icitly used a ^multiresolution" approach: 
we have written successive coarser and coarser approximations to f (the / J ， 
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averaging / over larger and large? intervals), and at ever/ step we have written 
the difference between the approximation with resolution 2 J_1 ，and the next 
coarser level，with resolution 2 J , as a linear combination of the In fact』we 
have introduced a ladder of spaces representing the successive resolution 

levels: in this particular case, = {/ 6 L 2 (R )； / piecewise constant on the 
\2 3 k, 2 J (k + 1)(, k € Z}. These spaces have the following properties ： 

(1) - • C V 2 C C F 0 C V_! C K-2 C ■ •; 

(2) = U^ = ^ 2 (R )； r * 

⑶ “ /(2^.) e Vo ； 

(4) / € Vo — > /(* — n) G for ail n 6 Z. 

Property 3 expresses that all the spaces are scaled versions of one space (the 
“multiresohition” aspect). In the Haar example we found then that there exists 
a function ^ so that 

- Proj Vj Proj Vj / + (/ ， 毛， 0 也 ， * • (1-3.5) 

keZ 

The beauty of the multiresolution approach is that whenever a ladder of spaces 
Vj satisfies the four properties above, together with 

(5) 彐沴 € Vb so that the = <j>(x — n) constitute an orthonormal 

basis for Vq % 

then there exists il> so that (L3.5) holds. (In the Haar example above, we 
can take <j>(x) = 1 if 0 < a: < 1, = 0 otherwise.) The 也 ，* ccmsti- 

tute automatically an orthonormal basis. It turns out that there are many 
examples of such "^nultiresolutioa analysis ladders，” corresponding to many ex¬ 
ample^ of orthonormal wavelet bases. There exists an 战 plicit recipe for the 
construction of since 0 € Vo C Vlj, and the 0_i >n (x) = %/2 <f>(2x — n) 
constitute an orthonormal basis for VLi (by (3) and (5) above), there exist 
a n ^ y/2 so that <j>(x) = 53 n ct n <f>(2x - n). It then suffices to take 

7p(x) = J3 n (—l) n a_ n+ i 4f(2x-*n), The function 4> is called a seeding function of 
the multiresolution analysis. The a»Tespondence multiresolution analysis -+ or- 
thonormal basis of wavelets will be explained in detail in Chapter 5, and further 
explored in subsequent chapters. This multiresoiution approach is also linked 
with subband filtering, as explained in §5.6 (Chapter 5). 

Figure 1.8 shows some examples of pairs of functions <f> y ip corresponding to 
different muitiresc^ution analyses which we will encounter in later chapters. The 
Meyer wavelets (Chapters 4 and 5) have compactly supported Fourier transform; 
<j> and ^ themselves are infinitely supported; they are shown in Figure 1.8a* The 
Battle-Lemari^ wavelets (Chapter 5) are spline functions (linear ki Figure 1.8b, 
cubic in Figure 1.8c), with knots at Z £or at for ij>. Both 4> and ip have 
infinite support, aad exponential decay; their numerical decay is faster than 
for the Meyer wavelets (for comparison, the horizontal scale is the same in (a), 



Fig_ 1.8. Soi^e,igwji^les of ojihonormal wavelet bases. For every ^ in this figure, 
famUy — — k), j, keZ, eonstUute* an orthonormai basis of X* a (M). 

figure plots ^ (the ntocig^d teeming function) orul ♦ for different canstructioru which we 
encounter m later chapter*, (a) The Meyer wavelet*; (b) and (c) Battie^Lemarii wavel 
(d) the Hoar raavetet; (e) the next member of the family of compactly supported wavelets. 


new oan9 oj xj \ 

ttrucHons whict 
attie^LemarU 


(d) the Hoar 


(0 another oompacUy supported 


member oj 
wweiet, vnt 


less luymmetry. 
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(b)，and (c) of Figure 1.8). The Haar wavelet, in Figure 1.8d, has been known 
since 1910. It can be viewed as the smallest degree Battle-Lemarie wavelet 
(^Haar = ^bl.o) or also as the first of a family of compactly supported wavelets 
constructed in Chapter 6 , 如邮 =i 垆 - Figure I. 8 e plots the next member of 
the family of compactly supported wavelets 2 <f> and 2 ^ both have support 
width 3, and are continuous. In this family of (constructed in §6.4), the 
regularity increases linearly with the support width (Chapter 7). Finally, Figure 
1 . 8 f shows another compactly supported wavelet, with support width 11 ; and 
less asymmetry (see Chapter 8 ). 

Notes. 

1 - There exist other techniques for time-frequency localization than the win¬ 
dowed Fourier transform. A well-known example is the Wigner distribu¬ 
tion. (See ， e.g M Boashash (1990) for a good review on the use of the Wigner 
distribution for signal analysis：.) The advantage of the Wigner distribution 
is that, unlike the windowed Fourier transform or the wavelet transform, 
it does not introduce a reference function (such as the window function, 
or the wavelet) against which the signal has to be integrated. The disad¬ 
vantage is that the signal enters in the Wigner distribution in a quadratic 
rather than linear way, which is the cause of many interference phenom¬ 
ena. These may be useful in some applications, especially for, e.g., signals 
which have a very short time duration (an example is Janse and Kaiser 
(1983); Boashash (1990) contains references to many more examples )； for 
signals which last for a longer time, they make the Wigner distribution less 
attractive. Plandrin (1989) shows how the absolute values of both the win¬ 
dowed Fourier transform and the wavelet transform of a function can also 
be obtained by “smoothing** its Wigner distribution in an appropriate way; 
the phase information is lost in this process however,, and reconstruction is 
not possible any more. 

2. The restriction 60 = 1 ， corre&|>oncling to (1.3.4), is not very serious ： if 
(1.3.4) provides an orthonormal basis, then so do the = 2 — 、 

ip(2~ m x - nbo), with ^(x) = 1 如 疒 1 where 知勞 0 is arbi¬ 
trary. The choice ao = 2 cannot be modified by scaling, aod in fact ao 
cannot be chosen arbitrarily. The general construction of ortBonormal 
bases we will expose here can be made to work for all rational choices for 
ao > 1, as shown in Ausdier (1989), but the choice ao — 2 is the simplest ‘ 
Different choices for ao correspond of course to diff^ent ip. Although the 
constructive method for orthoiKHrmal wavelet bases，called multiresdiutioD 
analysis, can work only if ao is rational, it is an open question whether 
there exist orthonormal wavelet bases (necessarily not associated with a 
* multiresolution analysis), with good time-frequency localisation，and with 
irrational oq. 



CHAPTER 2 __ 

The Continuous Wavelet Transform 


images of L 2 -functions under the contuiuous wavelet transform constitute a 
^producing kernel Hilbert space (r.k.H.s.). Such r.k.H.s.'s occur and are useful 
many different contexts. One of the simplest examples is the space of all 
iMdlimited functioos, discussed in §§2-1 and 2.2. In §2.3 we introduce the 
£@licept of band and time limiting; of cours&no nonzero function can be strictly 
/ _e~limited (i.e., /(f) — 0 for i outside \—T, T]) and band-limited (f(0 = 0 for 
杂 祭 but one can still introduce tin^-and-band<4imiting operators We 
ptcsent a short review of the beautiful wwk of Lapdau, Poliak, and Slepian on 
ibis subject. We then switch to the continuous wavelet transform: the resolution 
cCthe identity in §2.4 (with a proof of (1,3.1)), the corresponding r.k.H.s. in §2 5 
§2.0 we briefly show how the one-dimensional results of the earlier sections 
Can be extended to higher dimensions. In §2.7 we draw a parallel with the 
continuous windowed Fourier transform, la $2.8 we show how a different kind 
of time-and-band^limiting operator c 油 be built from the continuous windowed 
Fourier transform or |rom the wavelet transform. Finally, we comment in §2 9 
on the “zoom-in” property of the wavelet transform. 


{ 


2.1r Band limited functions and Shannon’s th 


function / in X 2 (R) is called bandltmited if its Fourier transform Tf has 
: ti^npact support, i.e” /(C) = 0 for |^| > ft. Let us suppose, for simplicity, that 
H = 7r. Then / can be represented by its Fourier series (see Preliminaries), 


where 
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= 

- =a") 

where we have interchanged integral and summation in the third st 印 ， which 
is only a priori justifiable if jcnl < oo (e.g., if on!y finitely many a* are 
nonzero). By a standard continuity argument, the final result holds for band- 
limited / (for every x, the series% absolutely summable becattse f/(w)p = 
2 tt l^rj 2 < oo) - Formula (2.1.1) tells us that / is completely determined by 
its “sampled” values /(n). If we lilt the restriction H = tt and assume support 
/ C with H arbitrary，then (2.1.1) becomes 

伽： E /(4) (⑴) 

Tl 

tlie function is now *determiiied by its samples /(njJ), cofre^>onding to a 

“sampling density” of Q/n = ,! . (We use the notation \A\ for the 

“size” of a^set C R» as meaBu^d by the Lebesgue measure ； id this case 
[support /[ = |[-fl,n]| = 奶 .）Hus sanKpling density is tisually called the 

Nyquist density. The expansion (2.1.2) gooQ by the name of Shannons theorem. 

* 



The “elementary building blocks* in (2,1.2) decay very slowly (they aiie 
not ev^n absolutely integr&ble). u Oversamplii!g n makes it possible to write / asa 
superposition of functioos witii &ster dec^. Suppose that / is still bandlimlted 
in [~n t n] (i.e., support / C [—0,0)}, but that / is sampled at a rate (1 + A) 
faster than the Nyquist rate，* with A > 0. The^i / can be recovered from the 
f(nn/\Q(l + A)]} in the following way. Define g\ by 
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ft<m<(i + A)n f 

K|>(i+A)n 


Figure 2J). Because 身 入 s 1 on support /， we have /(f) = We 

iwi now repeat the same construction as before. 


,-»nfir/in{l+X)] 


with Cn 


V^r 

20(1 + A) 


(h(ITa)) ; 


处 e * 对 Pa(^) ^ * 


«(1 + A). 


n(i + A >」 


\/2ti 

20(1 + A) 


2sm[£6(l sin(xQA/2) 


G\ have faster decay than note that if X-*Q, then as 

^ipected. One can obtain even faster decay by dioosing gx smoother, but it 
not p^y to put too mudi effort into making g\ very smooth: true, G\ will 
㈣ very fast decay for asymptotically large x, but the size ol A imposes some 
^mdetions m the numerical decay of fo other words, & C°° choice of gx 
> r ibid»to G\ t^caying faster than any inverse polynomial, 

J lAwiscjvWd 十 ixir (心 ”， 

but iAti C^(X) can be very large: it is related to the range of values of 

the of §\ on [n ， ft(l 十 A)]，so that it is roughly proportional to 

What if / is ^dersam^ed^ Le., if support / = [-ft, 0], but only 

tbe -%A)|) are known, where A > 0? We have 


( n nfi^A)) 


1T,L 


成 f ⑹ c *n*€/|n(l-A)J 


夾 c .mrC/[Q(l-A)] 


【 /(e) + /(( + 2Q(1-A)) + /K- ^(l-A))], 
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where we have used that the e tnn ^^ a have period 2a, and where we have assumed 
A < § (otherwise more terms would intervene in the sum in the last integrand). 
This means that the undersampled /(n^~X)) behave exactly as if they were the 
Nyquist-spaced samples of a function of narrower bandwidth, the Fourier trans¬ 
form of which is obtained by “folding over” / (see Figure 2.2). In the “folded” 
version of /, some of the high frequency content of / is found back in lower 
frequency regions; only the |^| < 0(1 - 2A) are unaffected. This phenomenon is 
called aliasing; for undersampled acoustic signals, for instance, it is very dearly 
audible as a metallic clipping of the sound. 


2.2. BancUimited functions as a special case of a reproducing kernel 
Hilbert space. 

For any a, j3 y — oo < a < < oo, the set of functions * 

{/ € L 2 (R); support / C [a,/3]} 

constitutes a closed subspace of L 2 (R), i.e., it is a subspace, and all Cauchy 
sequences composed of elements of the subspace converge to an element of the 
subspace. By the unitarity of the Fourier transform on L 2 (R), it follows that the 
set of all bandlimited functions 

= {/ € L 2 (R); support / C 

is a closed subspace of L 2 (R). By the Paley-Wiener theorem (see Preliminaries), 
any function / in Bn has an analytic extension to an entire function on C, which 
we also denote by /, and which is of exponential type. More precisely, 

l/(^)l < ^ n . 

In fact, Bn consists of exactly those L 2 -functions for which there exists an an¬ 
alytic extension to an entire function satisfying a bound of this type. We can 



Fig. 2.2. The three terrrw /(C), /ft+ 20(1 - A)), and /(C - 2fl(l - A)) for |^| < ft(l - A), 
and their «um {tMdi Hne). 
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therefore consider Bq to be a Hilbert space of entire functions For / in Bn we 
have 



/W 




2tt y_n 


dCe ㈣ / dy f(y) 


dy f(y) 


sin fi(x - y) 

^ - v) 


( 2 . 2 . 1 ) 


(The interchange of integrals in the last step is permissible f e L 1 , i.e , if / 
is sufficiently smooth. Since, for all x % (?r(x - .J] — 1 sinfi (: r - ) is in L 2 (R), the 
conclusion then extends to all / in Bn by the standard trick explained in Pre¬ 
liminaries.) Introducing the notation e x (y) = ， we can rewrite (2 2.1) 

as 

f(x) = (f,e x ) . (2.2.2) 

Note that e x € Bn, since e x {^) = (2tt) _ 1 / 2 e~ lx( for |^| < ft, e x (^) — 0 for 

Id > a 

Formula (2,2.2) is typical for a reproducing kernel Hilbert space (r‘k.H,s). In 
an r.k.H.s. H of functions, the map associating to a function / its value f(x) 
at a point x is a continuous map (this does not hold in most Hilbert spaces 
of functions, in particular not in L 2 (R) itself), so that there necessarily exists 
e x eH such that /(x) = (f,e x ) for all / € (by Riesz’ representation lemma; 
see Preliminaries). One also writes 


/(x) = / dyK(x,y) /(y), 


I where K(x,y) — e x (y) is the reproducing kernel In the particular case of Bn, 
秦 there even exist special ar n = 昔 so that the e Xn constitute an orthononnal basis 
秦 for Bu, leading to Shannon’s formula (2.1.2). Such special x n need not exist in a 
W general r.k.H.s. We will meet several examples of other r.k.H.s.’s in what follows. 

? 2.3. Band- and timelimiting. 

*■ 

J F^mctions cannot be both band- and timelimited: if / is bandlimited (with 
arbitrary finite bandwidth)，then / is the restriction to R of an entire analytic 
function; if / were timelimited as well, support / c [—T,T\ with T < <x>, 
then / = 0 would follow (nontrivial analytic functions can only have isolated 
zeros). Nevertheless, many practical situations correspond to an effective band- 
and timelimiting ： imagine，for instance, that a signal gets transmitted (e.g. * 
over a telephone line) in such a way that frequencies above Q are lost (most 
realistic transmission means suffer from this kind ofbandlimiting); imagine y also, 
that the signal (such as a telepfione conversation) haa a finite time duration. 
The transmitted signal is then, for all practical purposes’ effectively band- and 
timelimited. How can this be? And how^ well can a function be represented fay 
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such a time- and bandlimited representation? Many researd^exs worked on these 
problems, until they were elegantly solved by the work of H. Landau, H. Pollack, 
and D. Slepian, in their series of papers Slepian and Poliak (1961) and Landau 
and Poliak (1961, 1962). An excellent review, with many more details than ace 
given here» is Slepian (1976). 

The exsunple mentioned above (signal with finite time duration transmit¬ 
ted over a bandlimiting channel) can be modeled as folkiws: let Qt, Pn be the 
orthononnal projection operators in L 2 (R) defined by 

lQTf)(x) = f(x) for |x| < T, (Qt/){x) = 0 for \x\ > T, 
and * 

(Pof) A (0 - HO for Kl < n, ,(^n/) A (0 = 0 for |^| > fi . 


Then a signal which is timelimited to satisfies / = Qt/ ，and transmit¬ 

ting it over a channel with bandwidth U gives as end product PqJ =： PaQ-rf 
(provided there is no other distortion). The operator PqQt represents the total 
time + band limiting process. How well the transmitted PnQrf 8j>proadies the 
original / is measured by ||PnQT/|| 2 /l|/|| 2 ^ (Qt Pn Qt A/)/ll/[I 2 . 

The maximum value of this ratio is the largest eigenvalue of the symmetric 
operator Qr Pu Qt 、given explicitly by , 


(Qt Pn Qt f)(x) 


sinfl(a ： - y) 

^ - v) 


f(y) 

if |x| > T. 


The eigenvalues and eigenfunctions of this operator are now known e?q>licitiy 
because of a fortunate accident: Qt Pn Qt commutes with the second order 
differential operate 4, ' 

{A/)(x) = £(r 2 - #)£ -妄 - 


The eigenfunctions of this operator, which had been studied for different reasons 
long before their connection with band- and timelimiting was discovered，are 
called the prolate spheroidal wave fiiQctioiis y and many of their properties are 
known. Because A commutes with Qt Pn Qt (and because the dgenvalues A 
are all simple), the prolate spheroidal wave functions are aJso the eigenfunctions 
of Qt Psi Qt (with $Merent eigenvalues, of course). Mcn^ specifically, if we 
denote the prolate sphetoidal wave functions by iff ni ne N, ordered so that the 
ilcorres^ziding eigenvalues Qn of A increase as n increases, then 


Qt -Pn Qt 

Qr 丹 l Qr / = 0 妗 / 丄分 n ft>r all n 

供 ■ / is my>ported on {x; |x| ^ 2 1 }, 
A n decreases as n increases, and lim A tt «0 . 
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The eigenvalues A n depend on T and of course; an easy scaling argument 
(substitute x ~ Tx\ y — Ty f in the expresaon for (Qr Pq Qt /)(x)) shows that 
the X n depend only on the product TQ. For fixed TQ, the behavior of A n «s n 
Increases is BchematicaUy represented in Figure 2.3. lypically, th«.A n stay cloee 
to 1 for small n, plunge to zero near the threshold value TTU/it, and stay clooe 



0 10 20 30 

Fig. 2,3. The e%genvaluea A n for Qt^qQt 2T0/it — 25. 


to zero afterwards. More precisely, for any (arbitrarily small) t > 0, there exists 
a constant C £ so that 


# {n;A n >l- C }<^-C e log(rn) t 

# {n;l-€>A n >«}<2C e k>g(Tn) f 


(2.3.2) 


which means that the ^plunge region” has width proportional to log(TQ). Since 
limx^oo x~ l logx = 0 t the width of the plunge region becomes negligibly small, 
when compared to the threshold value 2TQ/n } as T, J3-*oo. In fact, (2.3.2) is a 
rigorous version of the fact that a time- and bandUmited re^on {~T y T\ x 
corresponds to 2TQ/n “degrees of freedom，” i.e. ( there exist (up to aa error, 
small compared to Tft) 2 TQ/tt independent functions (and not more) that 
are ess^itially timeUmited to [-T,! 1 ] and bancUimited to Note that 

,2TQ/7T is exactly the area of [-T y T] x [-Q,0], divided 2 tt. This num¬ 
ber is therefore equal to the number erf sampling times within [-T, T] specified 
by Shazmoa's theorem for a function with bandwidth O; this heuristic way of 
ccmnting the ^independent degrees of freedom” was part of the folklore of com- 
mOnication theory long before it was justified by Landau, Poliak, and Siepian. 
Independently^ it was also known to physicists that a region in phase space 
space-momentum, or time-frequency such as here) with area S corresponds 


to S/2k **ind^>endent states” in the semiclassical limit (i.e., when S is much 
krger than h; the expression S/2v corresponds to units such that h = 1). We 
will extend the definition of Nyqtiist density from its original sampling back- 
grouiid, and use it for the critical time-frequency density (2 霄 ) 一 1 present in all 
.these examples. 

^tae to return to the wavelet transfiwm. In what follows we will develop 
tilftpOsi^inKnis versiona of both the wsv^et transforai and the windowed Fourier 
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2.4. The continuous wavelet transform. 、 

We restrict ourselves^ for the time being，to one-dimensional wavelets. We aiways 
suppose that ip e Z- 2 (R); the analyzing wavelet should moreover satisfy the 
admissibility condition already mentioned in §1.3, 

C^ = 2ir jd^ 旧 - 1 |0(O! 2 < oo . (2.4.1) 

The role of this condition will soon become clear. If ^ € L l (R), then ^ is 
continuous and (2.4.1) can only be satisfied if V>(0) — 0, or / dx ^(ar) = 0. On 
the other band, if / da: ^{x) = 0 and we impose a slightly stronger condition 
than integrability on namely § dx (l + fx|) Q (^(x)} < oo for some a > 0 r then 
|^K)1 < C\^\ 0 , with 0 = min (a, 1), and (2.4.1) is satisfied. It follows that, for all 
practical purposes, (2 4:1) is equivalent to the requirement that / dx i>(x) — 0. 
(In practice, we will impose far more stringent decay conditions on if; than those 
needed in this argument.) 

We generate a doubly-indexed family of wavelets from i/» by dilating and 
translating, 

V^ 6 (x) = |a | _l ’ 2 矽 

where a, 6 € R, a # 0 (we use negative as well as positive a at this point). The 
normalization has been cho^n so that ||^ a,b || = |]t^j] for all a, b. We will assume 
that = 1- The continuous wavelet transform with respect to this wavelet 
family is then 

(r-VKM) = _ 

= j^ /(^) W~ 1/2 i) - 

Note that \(T^ v f){ti f b)\ < ll/ll- 

A function / can be recovered from its wavelet transform via the resolution 
of the identity, as follows. 

Proposition 2.4.1. For all f t g € L 2 (R), 

J: ( 广 v /)( ㈣ == CH (2.4.2) 

Proof. 

f: 厂学 (r-V)(o,6) (r-^)( a ； 6j 
= J J~^\J |a| 1/2 e -i ^ V»(aO 

[/V 丽 W 1/2 〆 MaC f )] • (2.4.3) 
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The expression between the first pair of bradcet& can be viewed as (27T) 1 〆? times 
the Fourier transform of F a (^) = |a|" 2 / ⑹ the second has a similar 

interpretation as (2 丌 ) " 2 times the complex conjugate of the Fourier transform 

of G o (0 = |a| 1/2 旮 (0 ^(a^). By the unitarity of the Fourier transform it follows 
that 

(2-4.3) = J 含 Jd^F a ( 0 G^f) 

= 2n j 告 \ j 心⑹丽 li^K)l 2 
= 2tt Jd^mm j ^ j^K)i 2 

- (interchange is allowed by Fubini's theorem) - 


= <7 必 {f,g) 

I 

(make a change of variables ^ in the second integral). ■ 

It is now clear why we imposed (2.4.1): if C* were infinite, then the resolution 
of the identity (2.4.2) would not hold. 

Formula (2.4.2) can be read as 

f = C t 厂 「 I 『 /KMX 、 （ 2.4.4) 

J —oo J *oo ® 

with convergence of the integral “in the weak sense,” i.e., taking the inner prod¬ 
uct of both sides of (2.4.4) with any g ^ L 2 (R) f and commuting the inner product 
with the integral over a, b in the right-hand side, leads to a true formula. The 
convergence also holds in the following, slightly stronger sense ： 


lim 

A] —0 
oo 


!-C^ 




da^b 


(T^ v /)(a,6) rp a>b 


0. (2.4.5) 


Here the integral stands for the unique element in L 2 (R) that has inner products 
with g € L 2 (R) given by 

// 学 ^ y f)M 9) ； 

m<B 

since the absolute value of this is bounded by 

1 丄 ^ ii/ii i”ii«/ ii y \\, 
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供 can give a sense to the integral in (2.4.5) by Riesz* lemma. The proof of 
(2.4.5) is then simple: , 


\\f-c; 1 JI 今與 (r- v /)( 與 6)d 

Ai<\a\<A7 


\b\<B 


=sup 
il9ll = l 


< sup 
llsli = 1 


< sup 


f 


A 'ml M 


dadb 

~^r 




Ci l f / 学 (T^ v /)(a,6) (T-vp)(a,6) 


or |a|<j4i 
or \b\>B 


ll/2 




fd 


学 n(M)i 2 


卜 - 7 / 


i«i< 七 

m>B 

dadb 

a 2 


|(7—p)(a,6)| 5 


1/2 


By Proposition 2.4.1, the expression between the second pair of brackets is 
||p|| 2 = 1, and k the expression between the first pair of brackets converges to 
zero as »0, A 2 y B~*oo t because the infinite int^ral converges. This estab¬ 
lishes (2.4.5). 

Formula (2.4.5)，which shows that any / in L 2 (R) can be arbitrarily well 
^>proximated by a superposition of wavelets, may seem paradoxical: after all, 
waveieta have integral zero, so how can any superposition of them (which nec¬ 
essarily still has integral zero) then be a good approximation to f it f itself 
happens to have nonzero integral? The solution to this paradox does not lie 
(as solutions to paradoxes so often do) in the mathematical ^lopplnegs of the 
question. We can easily make it alt rigorous: if we take / € Ir 1 (R) nX 2 (R), and 
if ^ itself is in L^R), then one easily checks that the 、 




A U' 


dadb 

a 2 


(r^/Kaj) f， b 


are indeed all in Z^(R) (with norm bounded by TO; 1 II/Hp OIU* IWU* 

— l ^ 2 )), and that they have integral zero, whereas / itself, the func¬ 

tion they are approaching as Ai—0, A^ % B^cx> f may well have nonzero integral. 
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The explanation to this apparent paradox is that the limit (2.4.5) holds in L 2 - 
sense, but not in i l -sense. As j4i—>0, 

m-c； 1 J f ^w/(a,6)r- 6 1 

Ai<laf<Ai 

m<B 

becomes a very flat，very stretched-otit function, which still has the same integral 
as / itself, but vanishingly small L 2 -norm. (This is similar to the observation 
that the functions p n (ar) = (2n)~ 1 for |x| < n, 0 otherwise, satisfy f 9n — I for 
£dl n, even though 5 n (a:)—>0 for all ai, and — {2n) _1 / 2 —0 for n~*oo; the 

g n do not convert in L^R).) 

Severn variations on (2.4.4) are possible, in which we restrict ourselves to 
positive a only (as opposed to the use of both positive and negative a in (2.4.4)). 
One possibility is to require that ij) satisfy an admissibility condition sli^itly 
more stringent than (2.4.1), namely 


^ -2tt / ^i4r l i^)! 2 -2^/ \m\ 2 < oo 


L 


(2.4.6) 


Equality of these two integrals follows immediately if, e.g .， 妒 is a real function, 
because then ^(-^) = ^(i). The resolution of the identity then becomes, with 
this new C 如 


^ J： S 


db^fia.b)^ 


(2.4.7) 


to be understood in the same weak or slightly stronger senses as (2.4.4). (The 
proof of (2.4.7) is entirely analogous to that of (2,4.4),) 

Another variation occurs if / is a real functtcm, and if support ^ C (0,oo). 
In this case, 


one easily proves that 


/ 




(2.4.8) 


with as defined by (2.4.1). (To prove (2.4,8), use that /(x)= ( 之兀广 1 ’ 2 
2Re /^° e tx ^/(^) f because /(—€) = /(()•) Formula (2.4.8) can of course be 

rewritten in terms of 妒 i = Re 矽 and 也 =Im 0’ two wavelets which aie each 
other’s Hilbert transform. Using a complex wavelet, even for the analysis of 
real functions, may have its advantages. In Kronland-Martinet, Morlet, and 
Grossmaon (1987), for ^Kampk，a complex wavelet ^ with support ^ c [0, oo) is 
used, and the wavelet transform T wav / is represented by graphs of its modulus 
and its phase. 為 

If both / iuid ^ are so-called “analytical aigoals，” i.e M if support / and 
扣明 Mwt 必 C [0»oo)，then T w * v /(o,6) = 0 if o < 0, so that (2.4.4) immediately 
sim^ifies to 

卜 C; 1 [ 卷广 db T^fia, b ， b 、 (2.4.9) 
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with again as defined by (2.4.1). Finally, we can adapt (2.4 t 9) to the cast 
where support C [0,oo), but support / (f. [0, oo). We write / = /+ + / 一， with 
support / + C [0, oo), support /_ C (~oo, 0], — and we introduce (^)= 

clearly supikjrt C (-oo,0]. Then - 0 and (/_, - 0 

for a > 0, so that, by straightforward application of (2.4.9), 

/ OO J ,oo 

^ J ^db \(^f)(a,b)^ b + (^ v /)(a,«e 6 ) , (2.4.10) 

where (7y ttV /)(a,6) = (/ +> i^+ 6 ) = (/，<>〉，(7T av /) is defined analogously, and 
is as in (2.4.1). . 

Another important variation consists of introducing a different function for 
the reconstruction than for the decomposition. More explicitly, if 畛 i ，必 2 satisfy 
that 

f 屯矿 1 hMOl 1^2(01 < 00 , ’ (2.4.11) 

then the same argument as in the proof of Proposition 2.4.1 shows that 

/§ (f^v b )(r/,9) - m ( 2 . 4 . 12 ) 

with ，如 = 2 -rr f Ifr 1 4i(0 心⑹， If / 0, then we can rewrite 

(2.4.12) as * 

卜 J~ jdb (/， 抑 X . (2-4.13) 

Note that and ^2 may have very different properties! One may be irregu¬ 
lar, the other smooth; both need not even be admissible: if = O(^) for 
0, then V>a(0) 一 Q is allowed. We will not use this extra freedoni here, Iq 
H olsdineider and Tchamitdiian (1990), the freedom in the choices of 畛 1 , 矽 2 is 
exploited to prove some very interesting results (see also §2.9). One can, for 
instance，choose ^2 to be compactly supported, support ^2 C [—so that, 
for any x, only the (/, with - x| < |o|il will contribute to f(x) in the 
reconstruction formula (2.4.13); the set {(a, b); |6 - a:| < |a|jR} is then called 
the “cone of influence” of ^2 cm ®. Holschneider and Tchamitchian (1990) also 
prove that’ with mild conditions on /, (2.4.13) is true pointwise as ^eli as in the 
L 2 -sense. 

Proposition 2.4.2. Suppose that that ^ is differentiable 

with e L 2 (R), that xip 2 € ^(R), and that 心 ⑼ = 0 = 多 2 ⑼. If f € I/ 2 (R) 
is bounded, then (2.4.13) holds pointwise in every point x where f is continuous, 
i.e. t 

/(X) = C ^S 人卿 (小 （ 2 . 414 ) 
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t 

Proof. . 

1. We can rewrite the right-hand member of (2.4.14) (before taking the limit) 
as 


fA u Ai ( x )= 


CiUJ 尝厂知 

iAi<|a|<y4a a J-oo 

' J 必 f{y)\ a \~ l ( 芑 a ’ ) 分 2 

f dy Ma x ,a 2 {x- y)f(y) » (2.4.15) 

J~~OD 


where all 
theorem ( 


the changes of order of integration are permitted by Pubini’s 
the integral converges absolutely). Here A/u 3 is defined by 


l a (~9 (^) - 


2 . One easily computes that the Fourier transform of Ma u a 2 is 

Ma^) = (27r)V2 乂 <|fl|<4 ^ ^2(^) (2-4 16) 

- M{A,0 - M{A^) , (2.4.17) 

where M(0 = (2 tt)" 2 C 心 3 / jo( > (£| g ^ 2 (a) 彡 i(a)，as follows from a 

change of variables a-+a^ in (2.4.16). Since a 《 2 (a) € L 2 (R) and is 
bounded, we have • 

咖 1 $ 刚命 _ |2 ) 1/2 (/ 坤 n 偏 2 广 2 
< m- 3/2 . 

By (2.4.11), M is also bounded, so that 

|MK)i<C(l + |Cir 3/2 , (2.4.18) 

implying that M, the inverse Fourier transform of M, is well defined, 

bounded, and continuous. 

3. The decay of Af is governed by the regularity of M. For 《 , 0, one easily 
checks that M is differentiable in with 


= ( 2 tt ) 1/2 ji | [^ 2(0 + $ 2(-0 ^ i (- 0 ] - 
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Because r ^ 2 e L 1 , ^2 is differentiable, so that, for ^ 0, 

d m\ 

=0 


dl 




It follows that M is differentiable. Moreover, since € X 1 , 

l^2«)l = I 心 (0 - 心 ⑼ I 


have 


< c 


h'< 




111 她 )1 


< C\^\ J dx, \xMx)\ < C 1 Kl, 

which implies |^M(o| < C H [|^i(^)| + |^i(-^)|], so that € 1?. It 
then follows from 


Jdx \M(x)\ 


■jl/2 r r 飞 1/2 

dx (1 -b X 2 )*" 1 / dx (1+a： 2 ) |A/(ar ) 卩 


< C 


炎 \m)f 


d 




m) 


1/2 

- < oo 


that M € Z/ A (R). Moreover, 心⑼ = (2 兀 )" 2 C ^ 1 ^ / ^j^(a) i^(a)= 
( 2 兀 )-" 2 , or Jdx M{x) ^ 1 . ’ 

4. Using (2.4.17) we can rewrite (2.4.15) as 

Because Jlf is continuous, integrable, and of integral 1 , the first term tends 
to f(x) for 0 if / is bounded, and continuous in x. (This follows from 
a simple application of the dominated convergence theorem.) The second 
terra is bounded by 


dy 




m 



/_ ^ 

: 飞 1/2 


fOO 1 

L dy M 

"㈢ 


y%i/(y)l 2 


1/2 


< a - i/2 m\ Li m^<cA； i/ \ 

because M € L 2 (R) by (2.4.18). This term therefore 
Aj—^oo. • 


to zero if 


Remark. In Holschnei 


ider and Tchamitchian (lddO) r this theorem is proved 
under slightly more general conditions on / as well as on 岭 1 ，必 3 . a 
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2 本办 reproducing kernel Hilbert space underlying the 

wavelet transform. 

special case of (2.4 2), we have, for / € L 2 (R), 


continuous 


C； 1 J /^t(T-V)(a,6)| 2 = / dx\f(x)f 


In other words, maps L 2 (R) i^mietrically into L a (R 2 ; C^a^ 2 dadb), the 
sppaqeof all complex valued functions F on P for which ||1F||| 2 = C: 1 J J 号券 
|F(a,6)| 2 converges; equipped with the norm [|[ |J| t this is a Hilbert space 
The image T^^L 2 ^) constitutes only a cloaedi^pbepace, not all of i 2 (R 2 ; 
C^ x a~f dadb)\ we will denote this subspace H, > 

^ The following, argument shows that H is a r»k._,s, Fpr any F € we can 
知 id / € Zr 2 (R) so that F = T^f、h follows then fr(?ni'(2.4.2) 

! F(a,b) - (/, r >b ) * 


C； 1 j J (T wav /)(a ， ,6 / ) ’ 

C； 1 j J K(a,b; a\b f ) F(a\b f ) (2 5” 


K(aM a\b r ) 


(T wav ^ a - t )(a , 1 ^) 


Fbrmula (2.5.1) shows that H is indeed an r.k.H.s. embedded as a subspace in 
， L 2 (R 2 ; C^ l a~ 2 dadb). (It also immediately shows that H is not ail of L 2 (R 2 , 
C^ x aT 2 dadb)^ since such a reproducing kernel formula could not hold for the 
whole vpace i»^(R 3 ; C^ x a~ 2 dadb).) 

In particular cases, H becomes 狂 Hilbert space of analytic functions Let 
us restrict ourselves again to functions / 8uch that support / c [0, oo), these 
functions form a dosed subspace of Z 2 {R) which we denote by If 2 (it is one of a 
* family of Hardy spaces). For ip we choose, for Instance ， 辠 (《）= 2^e~^ for 《 > 0, 
必 ( 《） s ?： 0 for f < 0 is also id /f a ). Then the functions in H 2 can be 
written as (consider only a > 0; see (2.4*9)) 


F(a t b) = </ ， 〆> 


2a 1/2 y d^ma^ e ~* ㈣ 以 


^ — (2ir) a 3 / 2 G(6 + io), 

wBK% G is analytic on the upper half plane (Im z > 0). Moreover, one easily 
chMsthat — 

<aa|G(6 + ia)| 3 = Jdx |/(x)f , 
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so that can be interpreted as an isometry from to the Bergman space 
of all analytic function on the upper half plane, square intcgrable with respect 
to the measure Im z d(lm z) d(Re 2 ). On the other hand, one can prove that 
any function in this Bergman space is ask)ciated, via the wavelet transform with 
this particular Vs to a function in H 2 : the isometry is onto, and is therefore a 
unitary map. For other choices of 必 ， such as e H 2 with = Np ^ 
for 妒 > 0， the image T wav // 2 can be identified with other Bergman spaces of 
analytic functions on the upper half plane. 1 

Since T^^L 2 or T wav f/ 2 can be identified with a reproducing kernel Hilbert 
&pace, ft should be no surprise that there exist discrete families of points 
(a a , 6 tt y such that / is completely determined by, and can be reconstructed from, 
(a Q , 6 q ). In particular, if T* av / can be identified with a function in 
a Bergman space, then it is obvious that its values at certmn tliscreite f^nilies 
of points completely determine the function, since it is, after all, an analytic 
function. Reconstructing it in a numerically stable way may be another matter: 
the situation is not as simple as in the band limited case, where there exists a 
special family of points x n such that tho a Xtt constitute an orthonormal basis 
for Bq. There is no such convenient orthonormal basis e a * t (» a in our T^^L 2 or 
T^^H 2 . We will see in the next chapter how this problem can be tackled. 

Finally, before we leave this section, it should he remarked that (2.4.4)，or the 
equivalent r.k.H.s. formulation, can be viewed as a consequence.of the theofy of 
square integrable group representations. I do not wish to'dwell on this in detail 
here; readers who are interested in learning more about them should consult 
the references in the notes, 2 The ip a,b are in fa^t the result of the action of the 
operators t/(a,6), defined by 

' W(a^)f\(x)^\a\~ l/2 f , 

on the function 私 The operators U(a,b) arc all unitary on I/ 2 (R), and con^itute 
a representation of the ax + 6-group: 

C/( a ,6) U(a\b f ) - U(aa\ 6 + a6 ; ), ' 


This group representation is irreducible (i.e., for any / / 0， there exists no 
nontrivial g orthogonal to all the U (a, fc)/，which is equivalent ta saying that the 
f/(a, b)f span the entire space). The following result is true ： if £/ is an irreducible 
unitary representatiem in K of a Lie^group G with left invariant measure and 


if for some / in Ti, 



d^g) |(/, V(g)f)\ 2 < oo , 


(2.5.2) 


then there exists a dense set I> m so that property (2.5.2) holds for any element 
/ of D. Moreover, there exists a (possibly unbounded) operator A t well defined 
in D, so that, for all / € D and all hi.h^ € K, 


j Q d^9) (huU{g)f) (h^M9)f) = C^M) , (2.5.3) 



THE CONTINUOUS WAVELET TRANSFORM 


33 


with ('j — In the wavelet case, the left invariant measure is a -2 dadb 、 

and A is the operator 

〃 (^/) A (o = kr 1 m - 

Note that (2.5.3) is a general resolution of the identity! 

In what follows, we will not exploit this group structure underlying the 
wavelet transform, mainly because we will soon go to discretely labelled wavelet 
families, and these do not correspond to subgroups of the ax + 6-group. 

In quantum physics, resolutions of the ideritity (2.5.3) have been studied 
and used for many difTorent groups G. The a^ociated families U(g)f are there 
called coherent states, a name that was first used in connection with the Weyl 
Heisenberg group (sw also next section), but later spilled over to all the other 
groups as well (and even to sorno related constructions which were not gener¬ 
ated by a ^roup). An excellent review and a collection of important papers 
on this subject can be found in Klauder and Skagerstam (1985). - The coherent 
states aai>ociatt'(i with tlu? ax + ^-group, which are now called wavelets, were first 
constructetl by Aslaksrn and Klauder (1968, 1969). 


2.6. The continuous wavelet transform in higher dimensions. 

t "There exist several possible extensions of (2,4.4) to L 2 (R n ) with ti > 1. One 
possibility is to choose the wavelet € i 2 (R n ) so that it is spherically symmetric. 
Its Fourier transform is then spherically symmetric as well, " ' 

^ - m-nm), 

and the fufmissihility condition becomes 

dt 


6V = (2?r) n 


j 吣 )| 2 < 


oo 


Along the taunm, lines as in the proof of Proposition 2.1 one can t^en prove that, 
for all f,g € I 2 (K n ), 


dQ 


db (T wav /)(a,6) = C^(f,g) , (2.6.1) 


：where (r wav /)(a, 6) = (f,tp a ' b ), as before, and ip a ' b (x) = with 

i € R+, a / 0, and 6 e R n . Formula (2.6.1) can again be rewritten as 




( 2 . 6 . 2 ) 


e It is also possible to choose a ^ that is not spherically symmetric, and to 
斑 ttoduce rotations as well as dilations and translations. In two dimensions, for 
Instance, we then define 


蠄 a ， M(x) = a _ V ( 巧 1 ， 
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where a > 0, 6 € R 2 , and where Re is the matrix 

( cos 汐 一 sin 汐 
sin 0 cos 0 

The admissibility condition then becomes 

C 唪 = (27r) 2 J ~~ J 油 |^(r cos^j rsin<9)| 2 < oo , 
and the corresponding resolution of the identity is 

/ = J d °『/)(〜_-’' 

A similar construction can be made in dimensions larger than 2. These wavelets 
with rot^tioi angles were studied by Murenzi (1989), and applied by Argoul 
et al. (1989) in a study of DtA (diffusion-limited aggregates) tmd other two* 
dimensional fractals. 



2.7. Parallels with the continuous windowed fburier transform. 

The windowed Fourier transform of a function / is given by 

(r^/Ku^H a 9^) , (2.7.1) 

where g' t,,t {x) — e wx g(x-t). Argument? completely similar to those in the proof 
of Proposition 2.4.1 show that, for all /i ，,2 € L 2 (R) t 

• J Jdwdt (T^/i)(u ； ,0^ w,n / 2 )(w,f) -2 tt \\ 9 \\ 2 (fuf2 ), 

which can be rewritten as 

卜 (2^(| 2 )- 1 J JcLjdt . (2.7.2) 

There is no admissibility condition in this case: any window function g in L 2 wffi 
do. A convenient normalization for g is !|^||jr,a = 1. (The absence of aitoissi- 
bility condition is due to the unimodularity of the Weyl-Heisenberg group — see 
Grossmann, Morlet, tod Paul (1985}.) 、 

The continuous windowed Fourier transform can agaiQ be viewed as a map 
fronl V L 2 (R) to an r.k.H.a .； the functions F e T wm L^{R) are all in L 2 (R 2 ) and 
moreover satisfy 




dujdt a/,〆 ） F(uf , 1 t , ), 


where w\t r ) = (p w，t， , (We assume || 训 》1 here.) Again there 

exist v^y specif choices for g which miuce this r.k.H.B. to a Hilbert space of 
analytic functions ： for ^(x) = rT 1 卜 exp(-x 2 /2), one finds 


(T win /)(a; 1 t)=exp ^(u 2 + t 2 )-~ut 0(u; + it), (2.7.3) 
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where ^ is an entire function. The set of all entire functions 4> which can be 
obtained in this way constitutes the Bargmann Hilbert space (Bargmann (1961))7 
The gt 1 ' 1 obtained from g{s) = 5 o(x) ; 7r~ 1/4 exp(-a: 2 /2) are often called 
the canonical coherent states (see the primer in Klauder and Sk^gerstam (1985)); 
the associate continuous windowed Fourier transform is the canonical coherent 
state representation. It has many beautiful and useful properties, of which we 
will explam one that will be used in the next section. Applying the differential 
operator H = -^+ar 2 — lto go(x) leads to 

( 一 “ + p _ i) €xp(~x 2 /2) ^ 0 , 


岭 t Le” 如 is an eigenfunction of H with^igenv^ue 0. In quantum mechanics lan- 
, guage, H is the harmonic oscillator Hamiltonian operator, and go ia its ground 
^ state. (Strictly speaking, H is really twice the standard harmonic oscillator 
' :Hamiltonian.) The other eigenfunctions of H are given by higher order Hermite 
l; functions, 


% 


= tt- 1 / 4 2-^ 2 (n!)-^ 2 [x 


l) 




#hich satisfy 


— 2n <f> n . 


(2.7.4) 


(The standard and easiest way to derive (2.7.4) is to write H = A*A, 
i where A : r + 盖 ， and A* is its adjoint A* — x - and to show that 
^ Ago =0, A(A*) n = (A*) n A + 2n(^*) n ^, so that H(j> n ^ a n A m A(A*) n g Q == 


oin A* 2n(A m ) n ^ 1 go = 2n <f> n \ the nonoalization a n can be computed easily 
as welL) It Is well known that the {^ n ; n 6 N} form an orthonormal basis for 
L 2 (R); they constitute therefore a “complete set of dgenfunctioiiB” for H. 3 
Let us now consider the one-parameter fffiooilies — exp(—These 
the soluticMw to the equation 



id • 也 = , 

In the very special 


(2.7.5) 


;h initial condition 岭 。 =In the very special case where 岭 o(x)= 沒 ?， : 
1/4 c «w* exp[-(x - t) 2 /2], we find if a = e*°* 说 •，“，where cj s ~ lj cos 2« ~ 
in 25, t t =uf sin 2s+ t cos2s, and q 9 = u B t a ) (as can easily be verified 

computation). That is, a canonical coherent state, when “evolved” 
it (2.7.5), remains a canonical coherent state (up to & phase factor which will 
^important to us); the label (u; St t 4 ) of the new coherent state is obtained 
the initial (a;, t) by a simple rotation in the time-frequency plane. 


,The 


The con 
resc^iitioQs 


fitinuous transforms as tools to build useful operators, 
of the identity (2.4.4), (2.7.2) can be rewritten in yet another 


C i l j ^ ^ 


Id, 


(2.8.1a) 
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— I j dudt {-, g^) = Id , (2.8.1b) 

where (•, <f>)<f) stands for the operator on L 2 (R) that sends / to (/ ， <p)(p; this is 
a rank one projection operator (i.e.，its square and its adjoint are both identical 
to the operator itself，and its range is one-dimensional). Formulas (2.8.1) state 
that a “superposition,” with equal weights, of the rank one piojection operators 
corresponding to a family of wavelets (or a fam ; ly of windowed Fourier functions) 
is exactly the identity operator. (As before, the integrals in (2.8.1) have to be 
taken in the weak sense.) What happens if we take similar superpositions, but 
give different weights to the different rank one projection operators? If the 
weight functipn is at all reasonable, we end up with a well-defined operator, 
different from the identity operator. If the weight function is bounded, then the 
corresponding operator is as well, but in many examples it is advantageous to 
consider even unbounded weight functions, which may give rise to unbounded 
operators. 4 We will review a few interesting examples (bounded and unbounded) 
in this section. 、 

We start with the windowed Fourier case Let us rewrite (2.8.1b) in the p y q 
(momentum, position) notation customary in quantum mechanics (rather than 
the a;, t notation for the frequency-time plane), and insert a weight function 

.I j dpdQ W{P ' Q) { '' 9P，q) ' (2 _ 8 , 2 ) 

1( w ^ I/°°(R 2 ), then W may be unbounded and hence not everywhere defined; 
as a domain for W we can then taJce {/; J J dp dq |u;(p ， g)| 2 |(/，< 
oo}，which is dense for reasonable w and g . 5 Two useful examples in quantum 
mochanics are (1) w(p,q) — p 2 , which leads to W" ~ ^ + C g Id, where 

C g = f $ 2 | 々⑹ | 2 ， and (2) w(p t q) — v(q), for which W" is a multiplicative 
potential operator: (Wf)(x) — V g (x) /(x), with V g (x) = f dq v(q)\g(x - q)\ 2 . 
Readers familiar with the basics of quantum mechanics will notice that in both 
cases the operator W corresponds pretty well to the “quantized version” of the 
phase space function w(p, q) (in units such that h — 1), with a slight twist: the 
extra constant C g in the first case, the substitution of -u * \g\ 2 for the potential 
function v in the second case. In fact both formulas were used in Lie 妗 (1981) to 
prove that Thomas-Fermi theory, a semiclassical theory for atoms and molecules, 
is “asymptotically” correct (for Z—oo, i.e.，for very heavy atoms); it gives the 
leading order term of the much more complicated quantum mechanical model. 
Lieb’s proof used the two examples above in three dimensions (rather than one); 
the operators he really wanted to consider were, of course, —A = — 纪 3 — 乾 3 
and V(x) — [xf + + x i]—" 2 , that he had to choo^& an appropriate g and 
deal with the extra constant C g and the difference between V and V * |p| 2 by 
some other means. Note that choosing v(^) with an integrabte singularity (such 
as the three-dimensional Coulomb potential) always leads to a nonsingular V g ： 
operators of type (2.8.2) cannot represent such singularities. 

Many othei applications of operators of type (2.8.2) exist. In pure mathe¬ 
matics they are sometimes called Toeplitz operators, and whole books have been 
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written on them. In quantum optics they are also called “operators of type 戶 ，” 
and again there exists an extensive literature on the subject (see Klauder and 
Skagerstam (1981)). 6 But let us go back to signal analysis, and see how (2.8.2) 
can be used to build time-frequency localization operators. 

-Let S be any measurable subset of M 2 . Let us return to time-frequency 
notation, and define, via (2.8.2), the operator Ls corresponding to the indicator 
function of S t a(uj } i) = 1 if (o», i) € 5, 0 if (w, t) ^ S, 

It follows immediately from the resolution of the identity that 

(LsL = 士 / j •鈾 dt\(f 、 gw)\ 2 

(<^,t)es * 

< ^ // MK/ ，， ’ ， | 2 H|/|| 2 ; 

« 

on the other hand, obviously (Lsf, f) > 0. In other words, 

0<L s <ld. 


irS is a bounded set, then the operator Ls is trace-class (see Preliminaries), 
since, for any orthonormal basis (wn) n€ ]^ in I- 2 (R), 


^ {L s u n , u n ) = ^ J J 

n (u ； ’f)es n 

(order of integral and summation may be inverted by 
* Lebesgue’s dominated convergence theorem) 



Such an operator has a very natural interpretation. If the window function g 
is reasonably well localized and centered around zero in both time and frequency, 
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then (/,s w,t ) g u,t can be viewed as an “elementary component” of /， localized in 
the time-frequency plane around (o; ， t). Summing all these components gives / 
again; Lsf is the sum of only those components for which (a;, t) € S. Therefore, 
L$f corresponds to the extraction from / of only that information that pertains 
to the region S in the time-frequency pleuie, and the construction from that lo¬ 
calized information of a function that “lives” on S only (or very nearby). This 
is the essence of a time-frequency localization operator such ss we saw in §2.3! 
We can now, moreover, study Ls sets S much more general than rectangles 
[-0, Q] x [-T,T]. (Note, however, that even for S = {-n,n) x [-T^T], our op¬ 
erators Ls are different from the Qt 多 h Qt considered in §2.3.) Unfortunately, 
for most choices of S and g, the ^graifimctions and eigenvalues of Ls are bard to 
characterize, and this construction is of limited usefulness. HcrwevCT, there is one 
choice of g and one particular family of sets S for which everything is transpar¬ 
ent. Take g(x) = g 0 (x) - exp(~ir 2 /2), and Sr = {(o/J); w 2 + i 2 < i2 2 }. 

Let us denote the corresponding localization operator by Lr, 

j j du ; 斜 

Th 明 e operators Lr commute with the harmonic oscillator Hamiltomai) 
H = - ^ + x 2 — 1 from §2.7, as can be seen by the following argument. Since 

with q # = (uft — u) a t s )/2 € R, w have 

9o' 1 ) 9o' % - (/» 9o' 1 ^ e~* a - (f, ； 

hence 

I 

Lr e~ tHa - i j J dh>dt (• ， 9o~ m,t ~ g ) e - 咖卜 , 

w*+t 3 <R 2 

If we substitute a/ = t l = t- 9j then one easily checks (use the explicit 
formulas for t s at the end of §2.7) that — = eKp [— — u;<)] 

e~ lHs . On the other hand, the domain of integration is invariant under the 
transformation >(o/ ， t’）(became this transformation is simply a rotation 

in time-frequency space!), so that 

Lr = 士 J J dJ dt f {•, ^ 

= L A , 

and Lr commutes with if, as announced. It follows that there exists an or- 
thononnal basis m which both Lr and H are diagonal (see Preliminaries). But, 
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since the eigenvalues of are all nondegenerate, there exists only one basis that 
diagonsdizes namely the Hermite functloxis (see §2.7). It follows that the 
Hermite functions </> n are necessarily the dgenfunctions of Lr. The eigenvalues 
of Ln can be computed from 


Wn, 9^) - (n\ 2-r^(-in^ + itY 


1 * 
—(w 2 + i 2 ) — — 


:: (There are many< ways to compute this expression. One way, via the Bargnu 
Hilbert space, is explained in Note 3 at the end of this chapter.) We then ha 


f 


.Lr 4>n — A n (/2)^ n , 


with 


K(R) 


<t>n, 4>n) 


2w 




J j ⑽ KK”I 2 


w 2 +t 2 </i 2 


// 

0> 2 +1 7 <^ 


duj dt {J 2 + t 2 ) n exp 


n! 2** 


w) 


l 0 drr ^ 


r exp 


H- 


>R 7 /2 




ds s n e" 


which is a so-called incomplete r-function. FVora this explicit formula for A n (i?), 
now possible to study its behavior as a function of n and R. I will summarize 
赛 the results here (details can be found in 0aubechies (1988)); Figure 2.4 also 

ff 導 Hrtiows a plot of Xn{R) for three different values of R. For every R, the A n (K) 
decrease moootonically as n increases; for small n they are close to 1, for large 
n close to zero. The threshold value around which they make this ^plunge, as 
4pfined T for example, by n t hr = max{n; A„ > 1/2}, is nthr — /? 2 /2. Note that 
is again equal to rril 2 /27r ， i.e.，the area of the time-frequency localization 
、 region Sr multiplied by the Nyquist den^ty, just as in §2.3. The width of the 
^^mge region is wider than in §2.3; however. 


l! 


# {n; 1 - c > A n > c} < C € R 


ccmipared to the logarithmic width in (2.3.2)), but it is still negligible, for 
H, when compared with nthr- Another striking difference with §2.3 is that 


« are independent of the size of the region Sr 
ive ftuu 


eigenfun 
T#nKke the F 
^^oicentrated 


ictions <f> n in this < 
the prolate spheroidal 
inthe A n (i2). 7 


ictioos): the /2-dependence is completely 
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)1_I1_II~~I~I~ t i 4 4 4* i 4 » 

0 5 10 15 20 

Fig 2 4 The eigenvalues A n (/i) for /? = 3, 5, and 7 


Examples similar to all of the above exist for the continuous wavelet trans¬ 
form We can again insert a non-constant function w(a,b) in the integral in 
(2.8.1a), and construct operators W different from the identity operator. An 
example is w(a,b) 〜 a 2 in three dimensions, with a spherically symmetric ^ 
(where the resolution of the identity is given by (2.6.2)), i.e., 

(WfKxJ^C- 1 JJ 3 ^ J^ 3 db^ a 2 (T—/)(a»^ b (x) , (2.8.3) 

where 矽 ⑹— 4>(\^\) and = (2?r) 3 / 0 °°ds s<l>(s). 

Because the three-dimensional Fourier transform of g(x) = |x)~ 2 is 

p(^) = v^/(v^F|《|) (in the sense of distributions), one easily checks that Wf 
can also be written as 


/ 办六 ■， （2 . 84 ) 

so that (Wf,g) represents the interaction Coulomb potential energy for two 
charge distributions / and g. This formula was used in, e.g., the relativistic 
stability of matter paper by Feffennan and de la Llave (1986). Notejjjat (Wf,g) 
becomes “diagonal” in the representation (2.8.3) (which, incidentally, is why 
it turned out to be useful in Fefferman and de la Llave (1986)). Note also 
that this diagonal wavelet representation completely captures the singtilarity of 
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• the kernel in (2.8.4) no “dipping off” of the singularity as in the windowed 
Fourier case. This is due to the fact that wavelets can zoom in on singularities 
(an extreme version of very short-lived high frequency features!), whereas the 
、 windowed Fourier functions cannot (see §1.2 or §2.9 ). 8 

We can also, as in the windowed Fourier case, choose to restrict the integral 
in (2.8.1a) to a subset S of (a, b)-space, thus defining time-frequency localization 
operators Ls- These are well defined for measurable S, and 0 < Z /5 < 1. For 
compact S not containing any points with a = 0, Lg is a trace-class operator. For 
general S, the eigenfunctions and eigenvalues may again be hard to characterize, 
k but there exist again special choices of ij) and S so that the eigenfunctions and 
eigenvalue of Ls are known explicitly. Their analysis is similar to the windowed 
Fourier case, but a bit more tricky. We will only sketch the results here; for full 
details the reader should consult Paul (1985) or Daubechies and Paul (1988). 
One such special is tp(^) = 2 ^ for ^ > 0, 0 for ^ < 0 ; the associated 
resolution of the identity from which we start is (see (2.4 9)) 

厂 尝厂必 f “ Of+ rj b )r- b ) = 1, 


where 矽 + = ip, — 6(—4) The operators Lc — Ls v we consider are given 

by 

Lc^c^ J j ~\{： Of + 〈 • ， r- b )r - b \, 

(a t b)^Sr 



with Sc = {(a, 6 ) e R+ x M ； a 2 -i- b 2 -h l < 2aC}, and C > 1 In the 
representation of (a, 6 )-space as the upper half complex plane (z ~ b + ia), the 
Sc correspond to the disks (2 —zC | 2 < C 2 — 1 . The role of the harmonic oscillator 
Hamiltonian is now played by the operator H defined by 


For this H we "have then 

exp(-z Ht)^ b = e 1Ql(a ， 6 ) ⑴， 


where 


b(t) 4 - ia{t) = z(t )= 


z cos f + sin i 
cos t — z sin t 


with z — b + ia. One easily checks that the flow z—*z(t) preserves all the circles 
\z — zC | 2 = C 2 — 1, as illustrated by Figure 2.5. It follows that H and the Lc 
so that they can be diagonalized simultaneously . 9 The eigenvalues of 
H all have degeneracy 2 ; for every eigenvalue E n = 3 + 2 n we can find two 


^genfunctions, 


(^) A (« 


2 V 2 [(n + 2 )(n+ l )】— 1 ’ 2 《 ^( 2 ^ 6 ^ for^ > 0 , 
0 for^ < 0 , 
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^genfunctions, 


(^) A (« 


2 V 2 [(n + 2 )(n+ l )】— 1 ’ 2 《 ^( 2 ^ 6 ^ for^ > 0 , 
0 for^ < 0 , 
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and (tpn) A (0 ~ (V , f t) A (~0- Here Lj is the Laguerre polynomial (2 is a super¬ 
script, not a power) as given by the general formula 


E (- 1 )， 


r(n + Q+l) _ 

r(n — m+1) r(a + m 4* 1 ) m! 


Since the operators Lc commute with the parity operation (II/) A (^) — /(-《>， 
it follows that 扣 ， are eigenfunctions for the Lc as well (because of the 
degeneracy of K, not every eigenfunction of 丑 is a priori an eigenfunction of 
Lc } )- The corresponding eigenvalues of Lc are 


(n + 1) 


(This means that Lc has the same degeneracy as if, so that in this case every 
eigenfunction of H is in fadt on eigraifunction of Lc as well.) We caD therefore 
also 喊％ = +^n) M eigenfunctions; these 
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have the advantage that they are real. Figure 2.6 shows the plots of the first few 
分 J ，(e for even, o for odd). A graph of A n (C) } for various values of C, ispven 
in Figure 2.7. For reasonably large C, the A n (C) behave as we by now expect of 
the eigenvalues of a time-frequency localization operator: they are close to 1 for 
n small, with A c (C) ― 1 - (亡 and they plunge to 0 for a larger, C-dependent 
value of n. More precisely, for any 7 € (0,1), the value of n for which A n (C) 
crosses 7 is equal to n ~ r/C + 0(l) (C large), with ^(2 + r/ _1 )(l - 2C~ 1 ) nC = 7 
or 2rj — Ia(l + 2 »j) = - In 7 + 0(C _1 ). This implies that . 

# {eigenfunctions; A n (C) > 7 } = 2# {n; A n (C) > 7 } 

= 2CF' 1 (~lji 7 ) + 0(l), 

where F(t) ~2t- ln(l + 2t). In particular, 

# {eigenfunctions; X n {C) > 1 / 2 } = 2C J F^ 1 (ln2) + 0(1) • (2.8.5) 


In order to compare this with the Nyquist density, we need to find the area 
ip time-frequency space corresponding to Lc- To do this, we go back tQ the ip± b . 
We have 



j dx |^J b (a :)| 2 = fe , ^ 

,/屯1(吨 6 )八(嫩=土莶. 

Hence Sc — {(fl, i>) 6 R+ x R ； a 2 *f +1 < 2aC) corresponds to the time- 
frequency set 

<2 + 占 + 1 ^萏} . 

This corresponds to a low frequency as well as a high frequency cut-off; see Figure 
2.8 for a comparison between this time-frequency localization 明 t and the disks 
of the windowed Fourier case . 10 The area of Sc is |5cr| — 6 tt(C- 1). Combining 
this with (2.8.4) gives 

# {eigenfunctiops; K(C)^im ; 丄 i^ (in2) + c^CT 1 ) 

|5c| 


which is different from the Nyquist dens%! This contradiction is only apparent, 
and is due to the fact that the width of the plunge region" of the Xn(C) ia 
proportional to C, and thus to |5c|. We have indeed, for e > 0 , 

# {eigenfunctions; c < A < 1 - «} 


^\Sc\ [l [F-HIWI-OD - c|)] + Od^r 1 )} 
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Fig 2 7 The eigenvalues A n (C) for different vcdnes of C 


in contrast to the prolate spheroidal wave case, where the analog of the expression 
between curly brackets tfends to zero as 问 _1 log 问 for |5|~->oo, and with the 
windowed Fourier case, where it behaves like |5| -1 〆 2 for |5 |—kxx The fact that 
in the present case the width of the plunge region is of the same order as |5c| 
itself results from the non-uniform time-frequency localization of the it 
is an indication that we have to be careful with time-frequeijcy-density-based 
intuition when dealing with wavelets. We will come back to this in Chapter 4. 

2.9. The continuous wavelet transform as a mathematical zoom: The 
characterization of local regularity. 

This section is entirely borrowed from Holschneider and Tchaniitchian (1990), 
who developed these techniques in part to study local regularity properties of a 
nondifferentiable function proposed by Riemarm. 

Theorem 2.9.1. Suppose that J dx(l + |x|) |^(x)| < oo, and 矽⑼ ~0. If a 
bounded Junction f ts Holder continuous with exponent a, 0 < a < 1, i.e., . 

\f(x)~f(y)\<C\x-~y\ a , 

then its wavelet transform satisfies 


\^ v (a,b)\ = \(f,r' b )\<C f |ar +1 / 2 . 
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Fig 2 8 (^) The set Sc = {(ijw), f 2 +^r + l<^} for different values of C (b) A 
comparison between the time-frequency localization sets for the vHndowed Founer transjorm 
(the^ dtsk Sr = {(i.w), t 2 -f- w 2 < i2 2 } at ieft) and for the wavelet transform (at right) 


Proof Since / dx i>(x) = 0 we have 


(f'f) ^ Jdx |a|-" 2 0 (^) [/(x) - /(6)1 


hence 


- 1/2 






|(^° )6 ,/>| < jdx\a\ 

SC |ar +1/2 J dy my)\ \y\ a 
< a |a | a+x/2 . ■ 


C\x - b\ c 


The following is a converse theorem. 

Theorem 2.9.2. Suppose that ^ ts compactly supported. Suppose also' that 
f € Z 2 (R) w bounded and continuous. Jf, for some a € ]0,1[, the wavelet 
transform of f satisfies 

■ |{/^°' 6 >[<^ +1/2 , (2.9.1) 

then. I w Holder continuous ynth exponent a* 
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Proof. 


1. Choose \J) 2 compactly supported and continuously differentiable, with 
/ dx ip 2 (x) = Q. Normalize ’咖 so that = 1. Then, by Proposition 
2.4.2 ， 

f(x )= 厂 ~ db . 

J—oo a oo 

We will split the integral over a into two parts, |a| < 1 and |a| > 1, and 
call the two terms fss(^) (smaU scales) and fi$(x) (large scales). 

2. First of all, note that fis is bounded uniformly in x: ' 

\hs(x)\ < [ 卷厂 db \^ b (x)\ \\f\\ L . || 派， 

^(a|>l a J-oo 

- c L>^ h(^) 

< C H^Hl 1 f ja|~ 3 ^ 2 -^< 00 . (2.9.2) 

Next, we look at |/ls(^ + /i) - /ts(a；)| for \h\ < 1: 


\hs(x + h) - Ils{x)\< h 备 [ 曲 [ dv 1/( 州 

_ i<K 中 )-01 

~~ (2.9.3) 

Since j 岭 2 ( 2 + 1 ) _ 分 2 ( 2)1 < C|f I， and since suppcHt 妒 ， support th. C 卜丑， 用 
for some it < 00 , we can bound this by 


(2*9.3) < a |hl / da a~ A f db f dy 


\f(y)\ 




< Cnh\ f da W " 3 [dy ' \f(y)\ 
IOl>1 f»-^ 2 |«|H+l 


r N>l 

< OU/IIp 


Wi 


da\a\- 3 (4\a\n + 2) 1 ^<C^ \h\ . 


This bolds for all \h\ < 1 ； together with the bound (2,9.2), we conclude 
that \fts(x + A) - /l 5 (*)| < C\h\ for all h t uniformly in x. Note that we 
did not evjen use (2.9.1) in this estimate: / 45 is always regular. 

3. The small scale part fss is also uniformly bounded: 
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< CU 2 \\l^ f da \a\- 1 ^ = C r < oo . ' 

- 

4. We therefore again only have to check \fss{^ + 办)一 /ss(x)| for small h, 
such as |/i| < 1. Using again ^(z + t) - t/> 2 (2：)| < C\t\, we have 

|/s5(x+/i)-/ 55 (x)| 


W\<\h\ 

+ f 


§/—> K ) 卜 K 午 )1) 


f % f db |ar C - 


< C 




Lt wl 


+a + \h\ / do|a|- 3+0 (|a|i2 + W) 

J\h\<\a\<\ 


C n |/l|° . 


It follows that / is Holder continuous with exponent a. ■ 


Together, Theorems 2.9.1 and 2.9.2 show that the Holder continuity of a function 
can be characterized by the decay in a of the absolute value of its wavelet trans¬ 
form. (Except for a = 1， where we do not have complete ^uivalence.) Note that 
we did not assume any regularity for ij) itself: apart from decay conditions on 
i), wc only exploited that J dx i)(x) = 0. (Although this condition is not stated 
explicitly in Theorem 2.9.2, if) nevertheless satisfies it: the bound (2.9.1) cannot 
hold otherwise.) Higher order differentiability of / and Holder continuity of its 
highest order well-defined derivative can be characterized similarly by means of 
the decay of the wavelet coefficients if ^ has more moments zero: in order to 
characterize f € C n and Holder continuity with exponent a of /( n ) we will need 
a wavelet ip so that f dx x m xp(x) — 0 for m = 0, 1 , • • • , n. For such a wavelet we 
have, for a € ]0,1[, - 

/ e C n , with all the /( m )，m = 0,…， n bounded'and square integ- 
rable, and /( n ) Holder continuous with exponent a 

- |{/» l 0 a,b )| < C|a| n+1 ^ 2+0( , uniformly in a . 

Again, we require no regularity for ip. 

What is most striking about all these characterizations is that they only 
involve the absolute value of the wavelet transform. Note that one can also 
derive regularity of / from the decay in a; of the absolute value of its windowed 
Fourier transform if the window g is chc»eii sufficiently smooth. In 

most cases however the value for the Holder exponent computed from |T ， win (a; J i)| 
will not be optimal. To obtain a true characterization, the phase of T wm (u;, t) 
should also be taken into consideration^ for instance via Littlewood- Paley type 
estimates (see, e.g., Frassler, Jawerth, and Weiss (1991)). 
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The wavelet transform can also be used to characterize local regularity, some¬ 
thing that cannot be achieved, oven when phase information is taken into ac¬ 
count, by the windowed Fourier transform. The following two theorems are again 
borrowed from Holschncider and Tchamitctiian (1990) 

Theorem 2.9.3. Suppose that f (hr (1 + |r|) \^(x)\ < oo and f dx -tp(x) = 0. 
If a bounded function f is Holder conimuous m x 0) with cjrjjonpnt a 6 ]0j 1), t.e., 

\f(x 0 + - f(x Q )\ < C\h\ Q , ^ 


then 


i(/,r tXo+f, )i <v» i/2 (i«r +ir) 


Proof. By tranHlating everything we can assume that ；ro -- 0. Because 


‘ f dx — 0, wc again have 

< c j^ w- \a \- l/2 

< c\a\^ l ^jdy |y4-~ "||/%)| 

< rn l/2 (wm- ■ 



Theorem 2.9,4. Suppose that ip is compactly suppoitvd. Suppose aho that 
f t L 2 (R) 15 bounded and continuous. If, for sottw 7 > 0 and a C )0,1[, 


I 〈/» ^ u,b )| S C|ap unifoTrnly^ tn b, 

and 

」 </ ，严〉 IWIal" 2 (K + nSi) 

then f ts Holder continuous m xq with exponent a. 


Proof. 

L The proof starts exactly like the proof of Theorem 2 9 2, of which the first 
three points caury over without change, with 7 taking over the role of a in 
point 3. 


2. We therefore only have to check |/ss(a：o + 厶） — fss{^o)\ for small h. By 
translating everything, we can assume xq = 0, and we obtain 

\fssW - ,S 5 ⑼ I • 
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Similar theorems for hi^ier order local regularity can be proved. These theo¬ 
rems justify the name Mathematical micmk;ope，” whidi is sometimes bestowed 
on the wavelet transform. In Hdschneider and Tch^mitchian (1990) these and 


other results were exploited to study the differentiability properties of the func¬ 
tion defined by the Fourier series n~ a sin(n 2 霄 a:)，first studied by Riemann. 
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1 . All these Bergman spaces can be further transformed, via a (standard) 
conformal map, to Hilbert spaces of aneUytic fainctions on the unit disk. 

2 . My main reference for this paragraph are the articles by Grossmann, Mor- 
let, and Paul (1985’ 1986). Their results can in fact be generalized to 
reducible representations as well, as long as tbey have a cyclic vector 
(A. Grossmann and T. Paul, private conmmmcation). This is useful for 
the higher dimensional case, where the representations of the ax-h 6 -group 
are reducible but cyclic. 

3. The operator Hb obtained by transporting” ff fcb the Bargmann Hilbert 
space, via the unitary map T wul J is particularly simple: 

产开 |* exp (一 >2 “2) 一 ■ 以 ) ♦ + ⑷ 

= exp (— i(o ; 2 + t 2 ) - ( 2 (u» + + zt)J , 

or (Hb<P)(z) = 0 ’( 2 ). It is obvious that the eigenfunctioiis of Hb are 

the monomials ii n (之 ） =(2 n z n . The following argument shows 

that these are indeed the fupctions in the BargmanA space corresponding 
to the Hermite functions. One easily computes 

T win A* (T win )—i exp ^-i(w 2 + £ 2 )- Iwtj + t 

— exp + t 2 ) - 基 + it ), 

so that 4> n - ( 2 n n\)~ l/2 (A*) n g a corresponds to ( 2 n n\)~ 1/2 (~i) n z n - 
(-i) n Un(z) in the Bargmann spiac%. (We use the normalization 

ll^llBargm- = h i ^ I d V i^(x 4 iy)\ 2 t so that g 0 itself corre¬ 

sponds io the constant function 1 in the Bargmann space.) In particular, 
this means that 




+1 2 ) - > (—) n (2 n n!)- 1/2 (a; + tt) n . 
4 2 


leads to an i 
represented in 


4. Not every unbounded function 
bounded operators 
weight function is 
trace-class operators require a non-tempered distribution as 
tionl 


unbounded operator; some 
can only be represented in this way if an unbounded 
used. In fact, Klauder (1966) proved that even some 

nght func* 


5. Fbr Teal functions w t one requires that W should be essentially self-adjoint 
on this domain. ' 
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6. Yet another application in quantum mechanics can be found in Daubechies 
and Klauder (1985), where it is shown how to write the (mathematically 
not well defined) path integral for exp {-itH) as a limit of bona fide Wiener 
integrals (as the diffusion constant of the underlying diffusion process tends 
to oo), provided H is of the form (2.8.2), with a weight function w{p,q) 
that does not increase too drastically for p, q—*oo. A similar theorem can 
be proved in the wavelet case (Daubechies, Klauder, and Paul (1987)) ‘ 

7. Exactly the same arguments hold for all operators W of type (2.8.2) for 
which w(uj, t) is rotationaily symmetric, even if it is not an indicator funo 
tion. An example is w(u,t) = exp[—a(o; 2 + f 2 )J, fof which it was first 
shown in Gori and Guattari (1985) that the Hermite functions are the 
eigenfunctions (irrespective of a; the eigenvalues depend on a, of course!). 

8. It is no coincidence that Fefferman and de la Llave would use a representa¬ 
tion of type (2.8.3) for the operator (2.8.4): after all, Calderon's formula (to 

• which (2.4.4) is essentially equivalent) is part of a toolbox developed pre¬ 
cisely for the study of singular integral operators (long before wavelets!) 
so that it is well adapted for treating the singular kernel in (2.8.4). In 
this particular instance, (2.8.4) makes sense even for nonadmissible ^ 
cancels out); in Fefferman and de ia Llave (1986), was taken to be the 
indicator function of the unit ball (which is nonadmissible, since its integral 
does not vanish). 

9. If we make an extra transformation, mapping the upper half plane 
{b + ia; a > 0} to the unit disk (by means 6f a conformal mapping), 
then everything becoihes more transparent: the flow z-^z(t) then corre¬ 
sponds to a siipple rotation around the center of Mie disk, and H as well 
as its eigenfunctions are given by simple expressions. See Paul (1985) or 
Seip (1991). 

10. There exist many other choices of ^ for which this analysis works. For 
each choice the set Sc in time-frequency space corresponding to Sc in 
(a, 6)-space takes on a-different shape. Explicit computations and a figure 
illustrating these different shapes can be found in Daubechies and Paul 
(1988). 



CHAPTER 3 _ 

Discrete Wavelet 
Transforms: Frames 


In this, the longest chapter in this book, we discuss various aspects of non¬ 
orthonormal, discrete wavelet expansions, together with some parallels with the 
windowed Fourier transform. The, “frames” of the chapter title are sets of non- 
independent vectors; they can nevertheless be used to write a straightforward 
and completely explicit expansion for every vector in the space. We will discuss 
wavelet frames as well as frames for the wJndowed Fourier transform; in the 
latter case, the' approach can be viewed as “oversampled” with respect to the 
Nyquist density in time-frequency space. 

m A lot of the material in this chapter has been taken from Daubechies (1990), 
Updated here and there. A very nicely written review of frames (and of the 
continuous transforms as well), with some additional original theorems, is Heil 
and Walnut (1989). 


3J. Discretizing the wavelet transform. 

In the continuous wavelel transform, we consider the family 

r'\x) = , 


警 3 :-, where b G E,,a € R+ with a ^ 0, and ^ is admissible. For convenience, in 
仑 the discretization we restrict a to positive values only, so that the admissibility 
' condition becomes 




处 r 1 1 她 : 


决 ⑹ — 1 \m \ 2 


< DO 


(See §2.4.) We would like to restrict a, b to discrete values only. The discretiza¬ 
tion of the dilation parameter seems natural ： we choose a — d^, where m € Z, 
&nd the dilation step a。_ 1 is fixed. For convenience we will assume ao > 1 
Although it does not matter, since we take negative as well as positive pow¬ 
ers m). For m = 0, it seems natural as well to discretize b by taking only 
the integer (positive and negative) multiples of one fixed b 0 (we arbitrarily fix 
©0 > 0), where is appropriately chosen so that the 分 (x ~ nbo) “cover” the 
whole line (in a sense to be made precise below). For different values of m, the 
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width of tp(aQ m x) is Oq 1 times the width of ip(x) las measured, e.g., by 

width (/) = [/ dx x 2 |/(a:)| 2 ] 1 / 2 , where we assume that / dx 卩 = 0 )， 

so that the choice b — nbo a^ 1 will ensure that the discretized wavelets at level 
m “cover” the line in the same way that the ip(x - n&e) do. Thus we choose 
a * O = n^ao 1 , where m, n range over Z, and oo > 1 ， 6 q > 0 are fixed; the 
appropriate choices for ao, &o depend, of course, on the wavelet tp (see below). 
This corresponds to 

- Q o m/2 ^ = ^0 - - (3-U) 

We can now ask two questions ： 

(1) Do the discrete wavelet coefficients {f，U completely characterize /? 
Or, stronger, can we reconstruct / in a numerically stable way from the 
(/»_ 

(2) Can any function / be written as a superposition of "elementary building 
blocks” U l Can we write an e»sy algorithm to find the coefficients in 
such a superposition? 

In fact, these questions are dual aspects of only one problem. We will see below 
that，for reasonable 於 and appropriate oo, 6o» there exist 分 so that the answer 
to the reccmstruction question is simply 


I ~ (/i Vm.n) 分 m，n ‘ 


It then follows that, for any g e L 2 (R) 


‘ (g，f 卜丽 ： (/, 

" \m，n 


^m,n) \^m t m 9) 


53 (£h 寸 rfi,n) ( 寸 m ， n ， f), 


m 9 n 


or g — n ^m.n) at least in the weak sense;is effectively a 

prescription for the computation uf the coefficients in a superposition of i/f m .n 
leading to g. We will mostly focus on the first set of questions here; for a more 
detailed discussion of the duality between ⑴ and (2)，see Grochenig (1991). 

In the case of the continuous wavelet transform, both questk>ns were answered 
immediately by the resolution of the identity, at least if was admissible. In 
the present discrete case there is no analog of the resolution of the identity, 2 so 
we have to attack the problem some other way. We cun also wonder whether 
there exists a “discrete admissibility condition," and what it is. Let us first give 
some mathematical content to the questions in (1). We will restrict ourselves 
mostly to functions / € I/ 2 (R) t although discrete families of wavelets, like their 
continuously labelled cousins, can be used in many other functioa spaces as well. 
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F\mctions can then be “characterized” by means of their “wavelet coefficients” 
{/ ， ^m.n) if it is true that 

(/i, H {fi 、for allm，n € Z 

implies fi^h ， 


or, equivalently, if 


{/, ^m,n> = o for allm,n € Z => / = 0 


: haracterizability: we want «ble to reconstruct / 
ay from the (/, «). In wder for such an algorithm 


I 


But we want more than 
in a numerically stable way from the (/ ， 岭 m n 〉. In wder for such an algorithm 
to exist, we must be sure that if the sequence ({/i, ^m, n ))m t neZ ^ “close” to 
4(/2 ，thep necessarily fi and / 2 were “dose” as wrfl. In order to 
make th^ precise, we need topologies on the function space' and <p the sequence 
space, ^^the function space L 2 {R) we already have its Hilbert space topology; 
on th^itequence space we will choose a similar ^-topology, in which the distance 
’ sequences c 1 = (c^ n ) min€Z and c 2 = (c^ tn ) minGi is measured by 

〆 lid-「 2 || 2 = E l C m,n~<n| 2 - 


I,ne2 


This implicitly assumes that the sequences ({/, ^m,n)) m ,n€Z are in £ 2 (Z 2 ) tliero- 
# selves, i.c., that ^m.n)! 2 < 00 for all / € L 2 '(R). In practice, this is 

>Uo problem. As we will see below, any reasonable wavelet (which means that 矽 
has some decay in both time and frequency, and that f dx = 0), and any 
'choice for ao > 1, 60 > 0 leads to 


EK /* ^ m , n )| 2 < B ||/|| ； 


(3.1.2) 


We will assume (without specifying any restrictions yet on the ^m.n ； we will 
come tack tot these later) that (3.1.2) holds. With the t 2 (7?) interpretation of 
“closeness,” the stability requirement means that if |(/, if m ,n}\ 2 *» small ， 
then [|/|| 2 should be small. In particular, there should exist q < 00 so that 
( , n K/, U 卩 S 1 implies ||/|| 2 < a. Now take arbitrary / 6 L 2 (R), and 
l^fine / = E mf n K/ ， 0m 』 2 r 1/2 /■ Clearly, E m ，„ 1(/ ， ^m,«>| 2 < 1 ； hence 
r J 2 < a. But this means 


Ei 〈/， 

jn t n 




ll/(| 2 <« 




(3.1.3) 


‘ 《 for tome A : 
、 dktwnce H/j 




or* > 0. On the other hand, if (3.1.3) holds for all /， then the 
/all caimot be arbitrarily large if E m ,„ K/i, U — (f 2 , 卩 
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It follows that {ej, e 〗， 63} i& a tight frame, but definitely not an orthonorxQal 
basis; the three,vectors f], e2, are clearly not linearly independent a 


A 



Fig 3 1 These three vectors tn C 3 constitute a tight frame 


Note 进 Mn this example the tiraine bound i4 = | gives the* “reduiuiancy 
rati^ w vectors in a two-dimensional space). If this redundancy patio, as 

0 i«ft9Qred by A, is equal to 1, then the tight frune is an orthonormal basis 
■* Proposition 3 2 1 If {<f 3 ) 3 ^j w a light frame, with frame bound A — 1, 
t j|^j I) = 1 for all j e J, then the (pj constitute an orthonormal basts 

^ Proof 3mce {/, <p } ) = 0 for all j € J implies / = 0, the ip 3 span all of W It 
j^madns to check that they are ortbonormal We have, for any j e J, 

IK = E . ， vv 〉 l 2 =HM 4 + E Ito ， w>l 2 • 

reJ jVj 

nee Hv^jll = 1, this implies (<pj, = 0 for ail ^ J. ■ , 

Formula (3 2.2) gives a trivial way to recover / from the {/, ip 3 ), if the frame 
tight. Let us return to general frames, an<| see how things work there We 
introduce the frame operator. 

DEFINITION If %s a frame tn H t then the frame opera'or F is the 

operator from H to £ 2 (J) = {c = (c^) j6 j ； ||c|| 3 — \c 3 \ 2 < 00} defined 

, jeJ 


It follows h-om (3.2 1) that 
F is easy to compute: 

w> 


(m = (/ ， 灼 ）. 

||F/|| 2 < B ll/ll 2 , i.e M F is bounded. The adjoint 

=(c, Ff) = (/, yp 3 ) 

i€J 

= ^2 C 3 (pj ，/) ， 


栅 that 


广 c = 9 灼， 


(3.2.3) 
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the operator (F*F)~ 1 to the vector^ ifij leads to an interesting n^w 
fsinily of sectors} which we denote by 争 j, * 

‘ a = (F*Fy i ^. 

The family (^) j€ j turns out to be a frame as. well. 

Proposition 3.2.3. The constitute ^ frame wth frame constants 

B " 1 mdA~ l f , 

B~ l \\f\\ 2 <^Kf t ^>| 3 <^|/# 3 - (3.2.6) 

- J€J 

The associated Jrame operator F : H —■*■ ^(J), (Pf) 3 — (/^ *p 0 ) satisfies 
# = F(F*F)- 1 , # ，戶 =(F*F)-S F*F * Id = and FF* ^ FF* ts the 
orthogonal projection operator, oniaBan (F) = Ran (F), 


As aa exercisej the reader can check that if a bounded operator S has a 
boun4ed inverse 5"* 1 , and if S* = 5, then (5 一 1 广： 5* 1 , It follows that 

(f^j) - a v,) - jtv ， 朽）； 



h|bce 

Ei</> ^>i 2 ^ E ^)i 2 = mm-vii 2 

j€J j€J 

= 〈 ( 广尸广 1 / ， F*F(F*Fr 1 f) = ((F*F)-V, /) • (3.2.7) 

By (3.2.5)，this implies (3.2.6); the <p 3 constitute a frame. Moreover, (3.2.7) 
implies also that the frame operator F satisfies F*F ^ (F*F)^ 1 . 

2. (F(F^Fr l f) 3 = {(F^F)- 1 /, ^>-</, ^> = (Ffh ， ' 

F*F^ \F(F*F)~ l ]*Fz= (F*F)~ l F*F^ld, 

F*F = F*F(F*F)~ l ^ Id. 

3， Since F — F(F*F)~ 1 , it follows that Ran (F) c Rmi (F). We have 
also F = F{F*F )； hence Ran (F) c Ran (F). Consequently^ Ran (F)= 
Ran (F). Let P be the orthogonal projection operator onto R^an (F). We 
want to prove that FF m — P, which is equivalent to FF m (Ff) « Ff 
(Le., FF* leaves elements of Ran (F) uacbaiiged) and FF*c 7 = 0 for all c 
orthogonal to Ran (F). Both assertions are easily diecked: 

FF*Ff = F ( 广尸疒 1 F*Ff : Ff 

and 

cl Ran (F ) 冷 <c ， Ff) =0 for all / € W 
F*c - 0 => FF*c = 0. m 
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We wili call (<p 3 ) 3 ^j the dual frame of {<Pj) 3 £j. It is easy to check that the 
dual frame of ^ the original frame (^) j€ / back again. We can rewrite 

some of the conclusions of Proposition 3.2 3 in a slightly 1 娜 abstract form; 
F*F = Id = F*F means that 

.* {/ > W A = / = E 〈/， W % ■ (3.2.8) 

3^ jej 


This means that we have a reconstruction formula for / from the {/, ^)! At 
the same time we have also obtmned a recipe for writing / as a, sdperposition of 
V?j, which demonstrate that the two sets of questions in §3.1 are indeed “dual.” 
When given a frame ((p 3 ) 3 ej 、the only thing we therefore need to do, in order 
to apply (3.2.8), is to compute the - (F*F) _1 tp 3 . We will come back to 
this soon. First we will address a question that often arises at this point: 1 have 
str^Sjed before that frames, even tight frames, are generally not (orthonormtd) 
bases because the (p 3 are typically not linearly independent. This means that for 
a given /, there exist many different superpositions of the ip 3 which ail add up to 
/. What then singles out the formula in the second half of (3.2.8) as especially 
inter 然 ting? We can get sui inkling of the answer with a simple example. 

Example. We revisit the simple example of Figure 3.1. We had there, for 
any v e C 2 , 

2 ^ 、 

* v e 3 - ( 3 . 2 9 ) 

Since e) = 0 in this example, it follows that the following formulas are 

also true ： 

v ^ 3 ^ + a l e J - (3.2.10) 

j=i 

where a is arbitrary in C. (In this particular case, one can prove that (3.2.10) 
gives all the possible superposition formulas valid for arbitrary t;.) Somehow, 
(3.2.9) seems more “economicar than (3 2.10) if a ^ 0. This intuitiw statement 
can be made m6re precise in the following way: 


乞 K 心 >1 2 = _ !MI 2 , 


whereas 


l(v, Ci) + «| S 


2 IWI 2 + 3|a| 2 > - ||v|| 2 if.a^O. 


Likewise, the (/, <p 3 ) are the most “economical” coefficients for a decomposition 
of / into (pj. 

Proposition 3.2.4. /// = c j f or 30me c - ( c j)j€J ^ ^(J), and 
if not all Cj equal </, (p } ) t then EieJ l c ji 2 > 



i 


DISCRETE WAVELET TRANSFORMS FRAMES 


61 


Proof. 

( 

1 Saying that / = c j ^Pj is equivalent to staying that / = F*c 

2 . Write c = a + 6 , where a e Ran (P 1 ) — Ran ( 句， and 6 丄 Ran (F) In 

particular, a 丄 6 ; hence ||c || 2 = ||o || 2 + ||lfl 2 . ” 

3. Since a e Ran (F), there exists g H so that a = Fg, or c — Kg + 6 . 4 
Hence / = F*c — F*Fg + F*b But 6 丄 Ran (F), so that F*b — 0, and 
F*F = Id. It follows that / = 分 ； hence c =c Ff + 6 , and 

' E W 2 = Wl 2 = II 戶 /II 2 + _ 2 = E 1 (/， 灿 2 + 胸 2 ， 

3€J j€J ^ 

which is strictly larger than l(/» unless 6 = 0 and c = Ff. ■ 


This proposition can also be used to see how the (p 3 play a special role m the 
first half of (3.2.8) - We typically have nonuniqueness there as well: there may 
many other families {u 3 ) 3 ^j so that / = {/ > ^j) «j. In our earlier 

two-dimensional example, such other families are given by u 3 — 著 e) + a, where 
蠢 Is an £urbitrary vector in C 2 . Since e, = 0, we obviously have 


咖 + 亡 e ；> a=v - 

however, the u 3 are "less economical” than the e^, in the sense that for 
v with ( v »°> ^ 


l(v, «j)| 2 l(v, e 3 )\ 2 ^Z\{v,a }\ 2 

j=i 

3 

=\ ||v|| 2 + 3|(t;,a)[ 2 > h\v\\ 2 = J2 e 3 )\ 2 


inequality holds for every frame ： if / = (/,' ipj)u 3 , then 

g)\ 2 > I 他， 5 )l 2 for all y € H, by Proposition 3.2.4., 

s ti-4^Badc to the reconstruction issue. If we know ^ = (F*F)~ l {p Jt then (3.2 8) 
^ 醜*加 how to reconstruct / from the {/, <pj). So we only need t6 compute the 
夸， f 、which involves the inversion o(F*F. U Band A are close to each other, i.e., 
读 # » B/A — 1 《1 ， then (3.2.4) tells us that F*F is “dose” to Id, so that 
^*)' 1 is “dose” to Id, and (jp 3 “dose” to (p r More precisely, 


J2 </» ^ 3 ) + R f - 


(3.2.11) 
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where = Id - ^ F*F ； hence Id < R < Id.^ This implies 5 

||/2|| < — 2 ^：. If r is small, we can drop the rest term Rf m {3.2.11), 

and we obtain a reconstruction Ibrmula for / which is accurate up to an L 2 - 
error of jj/jj. Even if r is not so small, we can write an algorithm for the 
reconstruction of / with exponential convergence. With the same 
H, we have 

A ^ B (Id-it); 


definition of 




2 


hence (F*F)~ l = 击 （W — H)~ l . Snce \\R\\ theories ^ 

converges in norm, and its limit is (Id —ii)" 1 . It follows that 


a = w% 


2 


A + B 


Y1 Rk( pj^ 


k=0 


Using only the zeroth order term in the reconstruction formula leads exactly 
to ( 3 . 2 . 11 ) with the rest term dropp 窃 1 We obtain better apprcmmations by 
truncating after N teims, # 




with 


2 


A^B 


E 妒 A p A - Y. Rk ^ = f Id ~ # +1 l A ， (3-2-12) 

fc=0 U fc==Af+l ’ 


卜 YAiw 的 


jeJ 


sup 

_=1 


sup 

m=i 


sup 
lh?l 卜 1 


〈卜 E (A 9 ) 


sej 




jeJ 






=sup la h n+i 9 )\ < m\\ N+l ii/ii < (^：)^ 1 ii/ii * 

which becomes exponentially smatl as N increases, since 击 < 1. In particuW, 
the can be computed hy an iterative algorithtn, 

" 心 jh 一啤 1 

or 

<=S ， 

eeJ 
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with 


4 = aTb 6(j + a „ - aTb S ^ - 




This may look daunting, but it is not so ternbfe ia exam 
where many (<p m ， <p t ) are negligibly small.. The same it 
applied directly to /: 


pies of practical interest, 
terative technique can be 




with 


In 


A-^-B 


E Rk ( F * F )/ 


fc =0 


JTB {rF)f + RfN 


/AT-] 


A^B 


—〈/m 朽 >1 朽 




Now that we have thoroughly explored abstract frame questions, we return to 
: i^Screte wavelets. 




FVames of wavelets. 


in §3.1 that in order to have a numerically stable reconstruction algo- 
樹 hm for / from the 分 m ， n 〉，we require jhat 伽 ip m , n constitute a frame- In 

屬 3,2 we found an algorithm to reconstruct / firom the {/, ^ mi „) if the do 
f€cmstitute a frame; for this 〜 algorithm the ratio Qf the ^rame bounds is important, 
|#nd we will come back to ways of computing at least a bound on this ratio, later 
this section. * First, however, we show that the requirement that the 汐 m , n 
institute a frame already imposes that 块 Is admissible 

.3.1. A necessary condition: Adimssibility of the mother wavelet. 
Theorem 3.3.1. If the <^ m ^ 2 ^(a^ m x - nbo), m,neZ f const%- 

a frame for L 2 (R) with frame bounds A, B t tiien 


知 lnao 
2 ?r— 


A < 


乂 。0 炎 r 1 mo \ 2 < 


6olnoo 

2 tt 


B 


(3.31) 


<fd^ Id* 1 W0I 2 < (3.3.2) 




: f?- 寺 ^^ - 
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Proof. 

1. We have, for all / € L 2 (R), 

^!I/!P< la ^^n)] 2 < B \\ff . (3.3.3) 

If we write (3 3 3) for / — Uf t and add all the resulting inequalities, 
weighted with coefficients Cf > 0 such that c f1l^ll 2 < °°> then we 
obtain 

^ QWI 2 S I ㈣ 5 5Z C «M 2 \ 

t e m,n t 

In particular, if C is any positive trace-class operator (see Preliminaries), 
then 、 

C - ^ ct {-, U() uf , 

teN 

where the U( are orthonormal, C( > 0, and Q = TV C > 0, For any 

such operator, we have therefore, by (3.3.4), 

- A Tv C<Y, {^Vw,n, U £BTrC. (3.3.5) 


We now apply (3 3 5) to a very special operator C, constructed via the 
continuous wavelet transform, with a different mother wavelet- Take h to 
be any L 2 -function such that support h C [0, oo), / Q °° |M^)} 2 < oo, 

and define, as m Chafpter 2, h a,b = cr 1/2 h (^) for a,6 G R, a > 0. If 
c(a, 6) is a bounded, positive function, then 


C 


da 


db {■, h a ' b ) h a ' b c(a t b) 


(3.3.6) 


is a bounded, positive operator 文 see §2.8). If, moreover, c(a,fe) is imtegrable 
with respect to a~ 2 da rffe, then C is trace-class, and TVC? — ^ 

c(a } fe)||hj| 2 . 6 We will in particular choose c(a,b) — 似 (|fcj/a) if 1 < a < ao, 
0 otherwise, with w positive and integrable. We then have 


C 


'da 


d6{*, h a ' b ) h a ' b w 


©， 


and 

TtC 


r ± 

Ji a 


ds «;(|s|) y/ijl 2 = 21n a 0 


ds w(s) 


\\hf • 



DISCRETE WAVELET TRANSFORMS FRAMES 


65 


3. The middle term in (3 3 5) beeomes T Tot this C, 
, da 


E Um,n 〉 = Y^ j 

m n m,n 

U，= «o m/2 « 一 1/2 I 


db w 


m,n 

But 




rli(ao m T 




Oo m/2 cr l/2 I dy if;[y) h 


y^nbo- ba^ m 

, 乃 —m 

u a 0 


= 〈矽， h a 。 一 ' a o" l6 - n6 °) 

After the change of variables a f (L^ m a, 1/ = aQ m b we ther€dfoi：e obtain 
(CVVi,n ， ■0m ， n> 


E 


代 一 m + 1 • 

'气 da' 




db f 


t(^> a ， lfe ， _n6o )f s 




|6 + n6oj ^ 


Tkke now «;(«) — A ^~ x2 ^ a2 This fusction has only one local maximum 
and is monotone decreasing as increases. An elementary approxmiAtioi 
argument for integrals (the full details of which can be found m Daubechie 
(1990), Lemma 2 2) shows that for such,functions w and for any a,/? € R 
0>0 ， 

poo _ poo 

I dtw(t) - <0^1 W ^ a + n 卢 ) s / dt ^( £ ) + ~max ， 

J -°° neZ 

or, for our particular w, 

士… )， 

n % ’ 

with |p(a t 6)| < w(0) = A. Consequently, 

E (U m ， n ) C 号 J°°db\(^ + (3.3.7) 


m t n 

whete 


f°°da r°° 

\r\ = y o ^ Ljbm ha,b )\ 2 p(^) 

< achM 2 , 
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which Ch as defined by (2.4.1), We can rewrite the first term in (3.3.7) as 

石 「 db ^ ° 1/2 ^ etb€ 2 
= - J^da 乂 。 V |_ 2 IMOl 2 - - \\hf 厂 W 1 _ 2 


4. For the particular weight function w that we have chosen, we have 


dt iu(t) = hence Tr C — ||/i|| 2 In ao- Sul^tituting all our results in 
(3.3.5) we find ’ 


^ \M 2 lnao < ~ \\hf r 1 l^(Oi 2 + R< BplP Inao, 

where Ii?I < A If we divide by ^ and let A tend to zero, 

then this proves (3 3 1). The n^ative frequency formula (3.3-2) is proved 
analogously. ■ 


Remarks - 

1 Formulas (3-3.1), (3.3.2) impose a priori restriction on namely that 

/o°° ^ r 1 1 摹 (0 卩 < oo and 1C! -1 | 彡(《)卩 < oo. This is the same 

restriction as in the continuous case (see (2.4.6)). 

2 In defining the discretely labelled we only took positive dilations 

aQ 1 into consideration (the sign of m affects whether aj* is > 1 or < 1, 
but, aj 1 > 0 for all m) This is the reason why formulas (3.3.1), (3.3.2) 
dissociate the positive and negative frequency domains. If we had allowed 
negative dis^e di}ati<»is as well, then the condition wcmkt have involved 
only 14 广 1 (as ia easy to dieck by rntmiddng the above 

proof). 


3. If the 沴 m , n constitute a tight franw (A = B), then (3.3.1), (3.3.2) imply 

^ _ = 丄 /> 矿 1 _ 2 . 

In particular, if the 分 m>n constitute an orthonormal basis of X 2 (R) (such 
as the Haar basis, or other bases we will encounter), then 

r 1 _) i 2 '/1炎矿 1 咖 2 = . _) 

It is an easy exercise that the Haar basis does indeed satisfy (3.3.8). Most 
of the orthcwiQrmal bases we will 访咖 ider are real, so that the first equality, 
in (3.3.8) is trivially satisfied. ' 


4. A different proof of Propositkm 3.3.1 is given in Chui and Shi (1991). □ 


In all that foUaws, we will alwagrs assume that tp is admissible. 
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3.3.2. A sufficient condition and estimates for the frame bounds. 
Not all choices for ao, feo lead to frames of wavelets, evrai if 咕 is admissi¬ 
ble. In this subsection we derive some fwrly general conditions on oo t i>o 
under which we do indeed obtain a frame^and we estimate th« corresponding 
frame bounds. To do this, we need to 雄 timate n [(/, 必 m , n )| 2 : 


E 1</ ， U 2 = E / 

m.neZ m,r» 


E< 


■2*fc 0 la i 






°dC e lfcoa o^^/(^ + ^£a^ m bQ- 1 ) + 2iri?6o" 1 ) 

/€Z 、、 

' 2 




E/^ + 2^ao m i>o' l )^«e + 2W 1 ) 

e^z 

(by Plancherel’s theorem for periodic ftmctions) 

^ ,DO - 


ra,Jb€Z 


+ 2nka^ m bo~ l )i>«0 必 + 2^^) 

^ |/(e)| 2 X ； l^)! ? + 細 t(/) - (3.3.9) 


Here Rest (/) is bounded by 


|Rest (/)| 


r 


E /狀如 

/(e + 27rfco^V ) 岑刚 + 27tkb^)\ 


< 




^ \m\ 2 m<o\ 2 妫 e)ij 

1/2 


1/2 


/ 成 i/(OI 2 IWC- 201 附 01 
J — oo 

(use Cauchy-Schwarz, and change variables 
(= 《— 2nkbQ 1 a^ m in the second factor) 


< 

fc#0 




「成 \m 2 I ； W<e + 2trA6 b - 1 )i 

J^oo m 


1/3 


/ <K l/(C)i 2 E m<0\ t^WC- ^O 1 )! 
.. 00 m 

(use Cauchy-Schwarz on the sum over m) 


1/2 
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(3 3.10) 


where 0(s) - sup t IV'WC)! + s)l- Putting (3.3.9) and (3.3.10) 

together, we see that 7 

inf ll/ir^KA^n)! 2 

/^o m,n 

^ ^ I ess inf I 摹(《)卩 - ^ ^ | (m” 

& up ||/r 2 Y1 \U^m,n)? 
m ， n 

^{t s 咏 aK)p +§ ( 令 ) r}. (3Ai2) 

If the right-hand sides of (3.3 11) ， (3.3 12) are strictly positive and bounded, then 
the ^>m,n constitute a frame, and (3.3.11) gives a lower bound for A, (3.3 12) a» 
upper bound for B. To make this work, we need that, for all 1 < {^j < oo (other 
values of ^ can be reduced to this range by multiplication with a suitable ag% 
except for ( = Or but this constitutes a set of measure zero, and therefore does 
not matter), 

0 < a < 53 liWO 卩 < /? < oo ; 

meZ , 

moreover, I 雀 W《)l I 雀 should have sufficient decay at oo. “Suffi- 

cient” in this second condition means that D* ‘ [ 卢 ( 普灸 ) 执一乾无 )1 1 ’ 2 converges, 
and that the sum tends to 0 as &o tends to 0, ensuring that for small- enough 
fco the first terms in (3.3.11), (3.3.12) dominate, so that the tp m ， n do indeed 
constitute a frame. In order to ensure all this, it is sufficient to require that 


• the zeros of ip do not “conspire，” so that 

m€Z 


(3.3.13) 


for all ^ ^ 0, 

• l^(C){ < C\i\ a (1 + m^ 2 , with a>0, 7 ><i + t 8 (3-3.14) 

These decay conditions on are very weak, and in practice we will require much 
morel If is continuous, and decays at oo, then (3.3.13) is a necessary condition ： 
iUorsome^o/0 ， I； m€2 t^«^o)| 2 < c, then one can construct / 6 L 2 (R), 
with ll/lj = 1， so that (2ir)- 1 6o Em, n K /， ^m,n)| 2 < 2c, implying A < 4ire/bo, 9 
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If e can be diosen arbitrarily small, then there is no finite lower frame bound (See 
also Chm and Shi (1991)，where the stronger result ^ |i^(ao l ^)| 2 < B 

is proved ) The following proposition summarizes our findings 
Proposition 3 3 2. If i/?, oq are such that 


inf 


E iwoi 2 > o, 


sup i^woi 2 < ( 

rn~~-ou 


(3 3 15) 


and if 0{s) — sup £ + s)| decays at least as faM as 

(1 十卜|) - ( 1+ *)， with c > 0, then there exists (fro)thr > 0 such that the ^m,n 
constitute a frame for all choices < (i»o)thr For bo < (^o)iw* 加 following 
expressions are frame bounds for the i， m ' n 

A= i {.< 1 ^ /} ， 

B ’i { 二！ _ 2 + Il KS*)(》)r 

The conditions on (i and (3.3 15) ore satisfied if ， eg ， |V f (^)| < (1 + J 《| 广飞 

with a>0, 7 >a+l 

Proof We have already earned out all the necessary estimates The decay 
of 0 ensures the existence of a (6o)thr so that Ylk^Q < 

inf l<l€i<ao Em 1 仏 ( 吸 0 卩 1 f ^ < (〜)*，• 


The moral of these technical estimates is simple- if 岭 is at all “decent” 
(reasonable decay in time and frequency, / dx 妒 (a:) = 0)，then there exists a 
whole range of Oo ， so that the corresponding 也 n， n constitute a frame Since 
our conditions on ^ imply that is admissible in the sense of Chapter 2, this is 
not so surprising for values of oo,6q close to 1,0 respectively ： we already know 
that the resolution of the identity (2.4.4) holds for such and it is reasonable 
to ©cpect that a sufficiently fine discretization of the integration variables should 
not upset the reconstruction too much Surprisingly enough, for many ^ of 
practical interest, the range of “good” (ao,bo) include values which are <juite 
far from (1,0). We will see several examples below. But first we will look at 
the dual frame for a frame of wavelets, and discuss some variations on the basic 
scheme. 


3-3.3. The dual frame* As we saw in §3.2, the dual frame is defined by 

= (P*F 广 1 (3.3.16) 
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where F*Ff = </ ， i>m,n) We have an escplicit formula for the 

inverse of F*F which converges exponentially fast, i.e” like an > with a 

convergence ratio a proportional to (j — l). It is therefore useful to have frame 
bounds A t B which are clc«e to each other. Nevertheless, (3.2.S) necessitates, in 
principle, an infinite number of ^ m , n to be computed. The situation is not quite 
as bad as one might expect: if we introduce the notation 

* (D m f)(x) = a 0 - m/2 /(% m x), (: T7)( ： r) = /(r - 《 6o ) ， 

then it is easy to check that, for all / € i 2 (R), - 

F m F D m f : D m F m Ff . 

Jt follows that (F m F)~ l and D m commute as well. In particular, since 於 m , n = 
D m T n ^ t 1 〜 、 

iK tn = p m r n ^ - rv ， 

or ___ ___ 

^m,n{ x ) = «0 ^0,n . 

Unfortunately, F*F and do not commute, so that we stilt have to compute, 
in principle, infinitely many >o， n . In practice, one is interested only in functions 
“living” on a finite range of scales, on which F*F can be r^ascoiably 叩 prox- 
imated by EneZ (*» U ^m,n (see the time-frequency localization 

section below, §3.5). If ao 1711 —" 10 is an integer, N — ao mi-m °) then one easily 1 
checks that this truncated version of F*F commutes with T N , so that one on|y 
has to compute the N different ^o,n> 0<n<iV—lin this case. This number is 
still \^ry large in many cases of practical interest, however. It is therefore spe¬ 
cially advantageoim to work with frames whidi are almost tight (^nug frames ”)， 
i.e., which have 受 一 1 《 1: we can th^n stop after the zeroth order term of 
the reconstruction formula (3.2,11), avoid all the complications with the du«3 
frame, and still have a high quality reconstruction of arbitrary On the other 
hand, there exist very special choices of 0, Oo,&o for which the are not ck>B6 
to a tight frame, but it so happens that all the i> mtn are generated by a single 
function, 

^n(x) - K=r) = % m/2 ^(ao m x-n). (3.3.17) 

An exampk is provided by some of the biorthogonal bases tliat we will encounter 
in Chapter 8; another example is given by the ^-transform of¥Vazier and Jftwerth 
(1988) (see also Frazier, Jawerth, and Weiss (1991)). 

It Is important to realise that the 岭 m , n and the ^ m , n may have very different 
regularity properties. Fbr instance, there eadst frames where ^ itself is C°° and 
decays faster than any inverse polynomial, but where some of the are not in 
U 1 for small p (implying that they have very slow decay). An example, due to 
P. 4 G. Lemarii, is given in detail in Daubechies (1990), 988-989. 10 Something 

similar may happen even if all the axis genereited 切 r & single function 
there exist examples where € C k (with k arbitrarily large)，but where ^ u 
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not continuous (The biorthogonal bases in Chapter 8 give examples where this 
happens; the first example was constructed by Tchamitchian (1989).) One can 
exclude such dissimilarities by imposing extra conditions on 必 ,ao, and &o (see 
Oaubechies (1990), §II.D.2, pp. 991-992). 



3.3.4. Some variations on the basic scheme. So far, we have not re¬ 
stricted the value of oq, beyond ao > 1- In practice, however, it is very conve¬ 
nient to have a 0 — 2. Going from one scale to the next then means doubling or 
halving the translation step，which is mudi more practical than if another ao is 
used. On th^ other hand，we have just seen that it is advante^eous to use frames 
with B/A — 1 《 1. Since our estimates (3*3.11), (3.3.12) for A, B give 

< B (3.3.18) 

- m€Z 

for all 《 〆0， these two requirements together imply that |'0(2 m C)| 2 

should be almost constant for ( = 0， which is a very strong restriction on 
not generally satisfied. The Mexican hat function if)(x) =» (1 - a: 2 ) e-**, 2 , for 
instance, leads to a frame with B/A close to 1, for ao < 2 1 〆 4 , but certainly not 
for ao = 2 because the amplitude of the oscillations of YimeZ |4(2 m 《)| 2 is too 
large. In order to remedy this situation, without having to give up too much of 
our freedom in choo^ng ^ and its width in the frequency domain, we can adopt 
a method used by A Grossmann, R. Kronland-Martinet, and J. Morlet, and use 
different ^voices” per octave. This aiiK)ui^s to 助 ing several different wavelets, 
垆 \ % and to look at the frame { 贫二 ，„; ra r n G 2, v — 1, * • • ,N). One 

can repeat the analysis of §3.3.2 (see, e.g” Daubechies (1990)), leading to the 
following estimates for the frame bounds of this multivoice frame ： 

A= i . (3.3,9) 

[ sup £ £ i^(2^)i 2 + ie 

with n 

^ 制 E I ，( ㈣ 办 K 2 ， 

and 

rw- sup f ； ir(2^)Hr<2^+ 5 )i 



h 

h 

i 


By choosing the 摹 、…， to have slightly staggered frequency localization cen¬ 
ters, coupled with good decay at c6, one can achieve B/A - 1 《 1. (See the 
Samples in |3.3,5 below.) The time-frequency lattice j^rrespondiiig to suck b 
multivcHce^sd&eme .looks a Uttle cUffefent ^Hp^l.4a; an example, with 



th. 


\if 3 \ will be concentrated around dfc2~^ ,_ 1 ^ 4 uq 

four voices per octave, is gvmi in Figure 3.2 - Fof eve^ dilation step, we find 
four different frequency levels (corresponding to the four different; frequency lo¬ 
calizations of 必 V • ，矽 4 ), all translated by the same translation step. Such a 
lattice can be viewed as the sup«position of four different lattice of the typ? 
in Figure 1.4a, stretched by different amounts in the frequency direction. Each 
of these four sublattices has a different “density,” which is reflected by the fact 
that typically the 寸 1 * have different L 2 -norms. One choice favored by Gross- 
mann, Kronland-Martinet, and Morlet is to take “fractionally” dilated versions 
of a single wavelet tf>: 

f(x) = 寧 . 

(Note that these do indeed have different ^-nonns!) In this case 

Eli Em=-oo l#(2 m 0P becomes simply EZ^-oo \^ m，/N ^)\ 2 , and this 
can easily be made to be almost constant, by choosing N large enough. 
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Fixing ao = 2 allows also for a modification of the estimation techniques in 
§3.2, which may be useful in some instances. Let us go back to the estimate 
for Rest (/). We can rewrite k€Z t k^O t ask~ 2 f {2k f + 1), where £ > 0, 
k f € Z; the correspondence A:—is owe-to-one. If 0 © = 2， then we can 
regroup different terms, and write 


Rest (/) 


This leads to 




2n 


E 

tnXZ 


fUm + 2ir(2k^\)bo- l 2- m， ) 


53 ^(2 / (2 m， C + 2ir(2£+4)fr 0 ' 1 )]. 




1/2' 


(3,3.21) 




%_ [0 +i) )0 


1) 


where 


-OO 


0M = sup V 

1 删 2 S 


E rP(2 m+e 0 6(2^(2n + S)) 


^=o 


(3.3.22) 


(3.3.23) 


These estimates are due to Ph. Tchamitchuui. (Pull details of the derivation can 
be found in Daubechies (1990).) Note that unlike /?, still takes the phas^ 
of ^ into atxsount; as a result, the estimates (3.3.21), (3.3.22) are often better 
than (3.3.11), (3.3.12) when ^ is not a positive function. If ip is positive, then 
(3.3.11), (3,3.12) may be better. The estimates (3.3.21), (3.3.22) hold if we have 
one single voice per octave; they can of course also be extended to the multivoice 
case. 


* 4 ! 


3.3.5. Examples. 

A. Tight frames. The following construction (first proposed in Daubechies, 
Grossmann, and Meyer (1986)) leads to a family of tight wavelet frames. Let v 
be a C k (or C°°) function from R to R that satisfies: 


咖） 


/ 0 if 
t 1 if 


x<0, 

X>1 


(3*3.24) 
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(see Figure 3,3). An example of such a (C 1 ) function v is 

( 0. x<0, 

sin 2 fa：, 0<x<l , 

1 , ^ > 1 . 

For arbitrary a 0 > 1, 6o > 0 we then define 4 土 (《)by 
== [lnao]~ 1/2 


^(3.3.25) 


0 , 

4 < eor (> ao 2 £ t 

Sln 卜 < 爲 )] ， 

W ， 

cos 卜 ( 5 ^ n )] ， 

^ f <^< ao 2 e f 


where £ — 27rf6o(flo 2 -* l)J _i t and 彡一⑹ = 彡 +(-《） Figure 3.4 shows 焱 + for 
oo = 2, 6o - I, and */ as in (3 3.25), It is easy to check that 


(support 焱 +| = (ao 2 — 1) 产 = 2n/bo 
and 

E l ^ + (^)! 2 = dna 。)- 1 x(o,oc ) ⑹， 

meZ 

where x(o,oo) ^ the indicator function of tiw^ open haJf line (0, oo), i e. 
X(r>,oo) (0 - 1 0 < ^ < oo. 0 otherwise. 

For any / € L 2 (R), one then has 


E ^ Oi 2 

m n€Z 


-E < 



{ 2 

炎 / ⑹ e 2 ” 《 «CI 《 oo 2 -”r ^+ 峨 ) 



Fig 3 3. The fun^ion v{x) defined by (3.3 25). 
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m62 


2tt 


froinao Jq 


di \m)\ : 



Simdariy, £ m>n |{/, = 

&0 ^0 /!«, ^ \f(0\ 2 - It follows that the 
collection n ; m,n € Z, f = + or -} is a tight frame for L 2 (R), with 
frame bound One can u*»e a variant to obtain a frame consisting of real 

wavelets: = Ee ^ I V-' 2 = im — 去 [ 设 + — 分一 1 generate 

the tight frame {^.m wi.n € Z, A = 1 or 2}. These frames a«e not generated 
by translations and dilations of a single function; this is a neural consequent of 
the decoupling of positive and negative frequencies in the construction. A more 
serious objection to their practical use is the fact that therr Fourier transforms' 
are compactly supported, and that the size of this support is relatively small (for 
reasonable oo,6q). As a result, the decay of the wavdlets is numerically rather 
slow ： even thou^b we may choose i/ to be C°° t so that the 矽土 decay faster than 
any inverse pdynomial, 

<C N (1 +W)~ w , 

the value of Cn turns out to be too large to be practical. Note that we did not 
introduce any restriction on ao, 6o in this construction.' 

\ 

B. The Mexican hat function. The Mexican bat function is the second 
derivative of the Gaussian if we normalize it so that its L 3 -aorm is 1, we 

obtain 〆 - 

， rl>{x) rr - " 4 (1 - x 2 )e^ x% ^ 2 . 

This function (and dilated and translated versions of it) was plotted in Figure 
1.2b; if you take one such plot, and imagine it rotated around its symmetry axis. 
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then you obtain a shape similar to a Mexican hat. This function is popular in 
vision analysis (at least in theoretical expositions), where it was also christened. 
Table 3.1 gives the frame bounds for this function, as computed from (3.3.19), 
(3.3.20), with a 0 2, for different values of bo and for a number of voices 
varying from 1 to 4. As soon as we take 2 or more voices, the frame may be 
considered tight for all 6o S .75. Note that 6o = .75 and (ao) e ffective = 2 1 ^ 2 ~ 1.41 
(intuitively corresponding to two voices per octave) are not small values for the 
Mexican hat function: the distance between the maximum of tp and its zeros 
is only 1, and the width of the positive frequency bump of ^ (as measured by 
lfo°° 处（卜匕 v) 2 |^(OII 2 ] 1/2 ,withW I 你 )| 2 )，is V372-1.23. For 

fixed N, and &o small enough, so that the frame is almost tight，the table also 
shows that A ^ B is inversely proportional to bo, which fits the intuition that 
for tight frames of normaJized vectors, A — B measures the “redundancy”- of 
the frame (see §3.2), which should indeed double if 6 0 is halved. On the other 
hsutid, the numbers in the table also show that B~fA increases dramatically if 6 0 is 
chosen “too large”. For every N, the last value of shown is the last value (with 
increments of .25) for which our estimate (3.3.19) {be A is positive; from the next 
bo on, the ip m 、 n are probably not a frame any more. This very abrupt transition, 
from a reasonable frame, to a very loose frame and then no more frame, as bo 
increases, was first observed by J. Morlet (1985, personal communication), and 
was one of the motivations for a more detailed mathematical analysis. 

C. A modulated Gaussian. This is the function most often uswi by 
R. Kronland-Martinet and J. Morlet. Its Fourier transform is a shifted Gaussian, 
adjusted slightly so that 摹 ⑼ = 0 ， 

= tt— 1/4 卜 -(5—。) 3 , 2 ~ e 一給， (3.3.26) 

rp(x)* = 7r~ l/ * -e~ € ° /2 ) e~ x2/2 . 

Often is chosen so that the ratio of the highest and the second highest max¬ 
imum of ij) is approximately i.e. = 7r[2/ln2] J / 2 ~ 5.3364. in practice 
.one often takes = 5- For this value of (o, the second term in (3.3,26) is so 
small that it can be neglected in practice. This Morlet-wavelet is complex, even 
though most applications in which it \s used involve only real signals /. Of¬ 
ten (see, e.g. ， Kronland-Martinet, Morlet, and Grossmann (1989)) the wavelet 
transform of a real signal with this complex wavelet is plotted in modulus-phase- 
form, i.e.，rather than Re {/, Im </ ，妒 m , n 〉，one plots j(/，and 

tan -1 [Im (/, 岭 m ， n 〉 /Re 〈/， the phase plot is particularly suited to the 
detection of singularities (Grossmann et al. (1987)). For real /, one can exploit 
/(-《）= /(《）to derive the following frame bounds (this is analogous to what 
was done in §2.4 for real /): 

^ll/H 2 < S 1(/. < B Jl/ll 2 for/real 

m,n€Z " 
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Table 3.1 

Frame bounds for wavelet frames based on the Mexican hat function t(/(x) — 2/^3 霣 "-" 磉（ 1 一 
i a )e _ * a / 2 . The dUatum parameter ao = 2 *n cdl case3 ； N m the number of voices. 


N = 1 


6o 

A 

B 

B/A 

.25 

,13.091 

14.183 

1.083 

.50 

6.546 

7.092 

1.083 

.75 

4.364 

4-728 

1,083 

1.00 

3.223 

3-596 

1.116 

1.25 

2.001 

3.454 , 

1.726 

1.50 

.325 

4.221 

12.986 

N 二 

3 



ho 

A 

B 

B/A 

.25 

40.914 

40.914 

1.0CKW 

.50 

2(X457 

20.457 

1.0000 

.75 

13.638 

13.638 

1.0000 

1 00 

10.178 

10.279 

1.010 

1.25 

7.530 

8.835 

1.173 

1.50 

4.629 

9.009 

1.947 

1.75 

1.747 

9.942 

5J691 


7V = 

2 



bo 

A 

B 

B/A 

.25 

27.273 

27.278 

1.0002 

.50 

13.673 

13.639 

1.0002 

.75 

9.091 

9.093 

1.0002 

1.^0 

6_7 併 

6.870 

1.015 

1.25 

4.834 

6.077 

1.257 

1.50 

， 2.609 

6.483 

2.485 

1.75 

.517 

7.276 

14.061 

N = 

4 




A 

B 

B/A 

.25 

54.552 

54.552 

1,0000 

•5Q 

,75 

27.276 

27.276 

1.0000 

18.184 

18.184 

1 0000 

1.00 

13.586 

13.690 

1.007 

1.25 

10.205 

11.616 

1.138 

1.50 

6.594 

11.590 

1.758 

1.75 

2.928 

12.659 

4.324 


with 


where 


： t%nd 


If 


n 2n I 1 

B = 6^ 2T 






E ite)i 2 + H 


m€Z 


R 


+ R 


⑼伯 )1 


1/2 


AW = T sup I IV»W0 + + «) + - 5)1 . 


m€Z 


ft 

These can, of course, again be generalized to the multivoice case. Table 3.2 gives 
s 拍 te frame bounds for ao~2 y several choices of 6q, and number of voices ranging 
from 2 to 4. In practice, the number of voices is often even higher. 
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Table 3.2 

FYame bounds for wavelet frames based on the modulated Gauastan, 0(af) ( c -*Co* _ 

e^o^) %u%ih = w(2/ln2) J/a . The diUUion constant ao - 2 m ofl owe «； N u ike 

number «/ votces. 


N = 2 N = 3 


bo 

A 

B 

B/A 

bo 

A 

B 

B/A 

.5 

6.019 

7.820 

1.299 

~5~ 

io,m 

1(X467 

1.017 

1 . 

3.009 

a.§io 

1.230 

1 . 

5.147 

5.234 

1.017 

1.5 

1.044 

2.609 

1.373 

1.5 

3.366 

3.555 

L056 

2. 

1.1 筇 

艺 .287 

1.950 

2. 

2.188 

3 雕 

1.372 

2.5 

.486 

2.282 

4.69a 

2.5 

1.1T5 


2.534 





3. 

.320 

3,^41 1 

9.824 


N =4 



A 

B 

B/A 


,13.837 

13.846 

1.0006 

1 . 

6.918 

6.923 

1.0008 

1.5 

4.540 

4.688 

1.032 

2. 

3.013 

a.sio 

1.297 

2.5 

1.708 

3.829 

2.242 

3. 

.597 

4.017 

6.732 


D. An example that is easy to implement. So far we have not addressed 
the question of how the wavelet coefficients 〈/， are computed in practice. 
In real life，/ is not given as a function, but in a sampled version. Computing 
the integrate f dx f(x) then requires some quadrature formulas. For the 

smallest scales (most negative m) of interest, this will not involve many samples 
of /， and one can do the computation quickly. For larger scsdes, however, one 
faces huge integrals, which might considerably slow down the computotipfi of 
the wavelet transform of any given function. Especially for on-line in^^lementar 
tions, one should avoid having to compute these long integrals, A construction 
achieving this is the so-called “algorithme a trous” (Holsclmeider et al. (1980)), 
which us^ an interpolation technique to avoid lengthy computations (for details^ 
I refer to their paper). Here I propose an analogous example (although it is not 
u a trous”），by borrowing a leaf from multiresolution analysis and orthonOTmal 
bases (to which we will come back), i.e” by introducing ait auxiliary function if>. 
The basic idea is the fdlowing: suppose there exists a function ^ so that 

- ^(x) = ^ (3.3.27) 

• 4，( x ) = c* 4>{2x - k) , ^3.3.28) 

k 
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where in each case only finitely many coefficients are different from zero. 11 
(Such pairs of <f>, abound ； an exsmnple i& given below. The K a%orithme 
4 trotl§” corresponds to special <f> for which co 1, all other even* indexed 
C 2 n — 0.) Here 沴 does not have integral zero (but 岭 does!), and we will 
normalize 彡 so that f dx <^ar) = L Define, even though ^ is not a wavelet, 
0m,n(^} = T~ m f 2 0(2~ ，m x - n); we take ag = 2, 6 q =* 1. Then it is clear that 


(/* ^ nt . n ) ~ {/i 〜》,«+*〉； 

* k 

problem of finding the wavelet coefficients is reduced to computing the 
{/ ， ^m,n) (finite combinations of which will give the (/, ^m.n))- On the other 
iMUMi, 1 t 

(/. ^m,n) = -^ Cfc {/» 决 m-K2«+fc ) ， 

so that the (f ; <hn,n) can be computed recursively, working from the smallest 
scale (where they are easy to compute) to the largest scale Everything is done 
by simple, finite convolutions 

An example of a pair of functions satisfying (3.3.27), (3 3.28) is 


t{x) = N 


沴 (i+ 1) + 决 (ac) - 1) 


1 ，. 


which corresponds to 


’ 衾 （工 + 2) 3 ， 

f - x 2 {\ + x/2) , -1 <x<0 , 
<K^) - < § -ac 2 (l -a:/2) , 0<a;< 1 , 

H 1<^<2, 


otherwise 


/ ^ & nonnalaation constant chosen so that J)V»|| =： 1; one finds N 13J 

5? Impure 3.5a shows graphs of 0, they are not unlike a Gaussian and its secor 
"wlvative, plotted in Figure 3,5b for comparison. The function if clearly satisfies 
翁 3.27) with dp = iV, d±% — —iV/2, all other d* = 0, whereas 


* (C08 e/2) 4 扣 0, 




80 


CHAPTER 3 


which implies 

诊 ( 怎） =|^(2x + 2) + 5^>(2 x + 1) + |0(2a:) + ^<p(2x — 1) + — 2), 

or co = f, r±i = i, c ±2 ~ §» ❶ ther c/t = 0 For this 也 a 0 = 2 and 6o 二 1， the 

frame bounds are A = 73178, B — 1.77107, corresponding to B/A = 2.42022; 
for a 0 = 2, 6© = .5 we have 4:2 33854, B - 2.66717, and B/A - 1.14053 
(using fco = .5 means that the recursion formulas, linking the 分 m ,„ with the 
<i>m,n and the <^ m , n with the <f> m _ i iTI , have to be adapted, but this is easy). Here 
we have used only one voice. It is of course possible to choose several different 
妒 ' corres^>pnding to different that give rise to a multi voice scheme, closer 
to tight frames. “ 

This concludes our examplr section, other examples are given in Daubechics 
(1990) (including «ne for which the rstimates (3.3.21), (3.3.22) outperform 
(3,3.11), (3>3.12)) Many other examples can of course be constructed. The 
wavelets used in Maliat and Zhong (1990) axe another example of the same type 
as our last oive; in their case ^ is chosen to be the first derivative of a function 
with non^zero integral (so that f dx ip(x) — 0 but f dxxip(x) / 0). 





Fig 3.5. An example that xa easy to implement: graphs of 0, (tn a), and a comparuon 
wtih a (?au«3tan and tts second derivative (tn b). 


3.4. Frames for the windowed Fourier transform. 


The windowed Fourier transform of Chapter 2 can 
natural discretization for in = e*^ x g(x 

where a;。，to > 0 are fixed, and m,n range 
is thus 

9m,n( x ) - e tmu>oX g(x - n<o) 


Jso be discretized. The 
t) is (j = Tnwo } t — n 《。， 
Z; the discretely labelled family 
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We can again seek answers to the sme questkms as in the wavelet case: for 
which choices of g t o ； o> can a ^meticaibe characterized by the inner products 
(/, when is it possible to recopstrucfc / in a numerically stable way from 

these inner products: can an efficient akotMthm be given to write / as a linear 


combination of the g m ’ n ? The answers are provided by 
framework: stable numerical reconstruction of / from its win 
efficients 


the same abst; 
dowed Fourier 


ract 
• co- 


</ ， ftn,»> = y dx f{x) 

is only possible if the 分 m , n constitute a fri 
so that 


— 9(x-n^h 

i y i.e., if there exist j 4 > 0, B < oo 


A [dx\f(x)\ 2 < ^ K/, 9m t n)\ 2 <B fdx l/(ar)i 2 . 
m ， n6Z 

If the gm tn constitute a &ame, then any function / € L 2 (R) can be written as 
/ — 〈 / ， 9m,n) 9m,n — 〈 / ， 9m t n) 9m,n > (3.4.1) 

*n,u m,n 

Vhere g^ n are the vectors in the dual frame; (3.4.1) shows Wth how to recover 
/ from the 〈 / ， g m>n ) and how to write / as a superpo^iion of the g m ' n . The de¬ 
tailed analysis of frames of windowed Fourier functioiis brings out some features 
^ different from wavelet frames, due to the differences in their constructions. 

"S.4.I. A necessary condition: Suffid^ntly hl^i time-frequency den¬ 
sity. The arguments in the proof of Tljewem 3.3.1 can be used fc^r the windowed 
Fburier case as well (with the obvious modifications), leading to the conclusion 


ML 5 


(3.4.2) 




frame of windowed Fourier functions，with £rame bounds A, B. 
||oes not impose any additional restrictkms on g (we always assume 


This 

g (we always assume g € L 2 (R)). 
consequence of (3.4.2) is that the frame bound for any tight frame equals 
^2^ (w»fo) 一 1 (if we dioose g to have norm 1 ); 扣 particular, if the p m . n constitute 
orthoiK»iiial basis, then wo^o = 2?r. 

The absence of any constraint on y in the inequalities (3.4.2) is similar to the 
absence of an admissibility condition for the continuous windowed Fourier traos- 
(prm (see Chapter 2)，and quite unlike the constraint f |4| _l |^(Q| 2 < oo on 
細 mother wavelet, necessary for wavelet frames as well as for the continuous 
Wavelet transform. Another ctifference with the wavelet case is tiiat the 
Iraquency translation steps to dnd 喊 are constrained: there exist 
Jburier frames for pairs u^t 。such that cjoto > 2ir. Even more is 

> 2ir t then for any choice of g € L 2 (R) there exists a corresponding 
/ € L 2 (R) (/ — 0) so that / is orthogonal to all the ^ m , n (x) = e imu ° x g(x-nto)^ 
this case the o mn not only fail to constitute a frame, but the inner products 


L»£tVUlUUU£> 

e time and 
windowed 
is true: if 


: <1 
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(/, 9m,n) ar« not even s 碰 cient to determine /. We are therefore restricted 
to iJoto < 2 tt; in order to have good time- and &equ^cy-lo6alization t we even 
ha 晚 to di&ose cj 0 t 0 < 2tt. Note that no simHar restricti<m bo existed in 

tbe wavelet case! We wiB come back on these conditions in Chapter 4, where 
we discuss in much greater detail the role of timt^firequency d^s^y for wrn- 
<10*1 味 d Fourier vetsus wavelet frames; we postpone our proof of the nedess^y of 
< 2ir until thm. 


3.4,2. A suffident condition and estimates for the fr«ai» bounds. 
Ev©a if u>ofo < 2 tt, the do not necessarily (institute & frame. An easy 
counterexample is g(x) = lfor6<a:<l, 0 otherwise^ if lo > I, thai any func¬ 
tion / supported in (1, t 0 ] will be orthogonal to all the gm t n, however small 
is chosen. In this example ess inf x fp(i - nf 0 )| 2 — 0, aad this is what stops 

the gmn from being a frame. (Soinething similar occurs kst wav^et Seames; see 
p.3.) 1 

Computations entirely similar to those in the wavelet case show that 

^ H/il " 2 E ， 

/ 神 m，n 

卿 n/ir 2 

/is 饵 ， " 

$ 尝 -_ 2 +g 卜 ( 尝 + (_s*)rf _ 

where j3 is now defined by 

則 =sup W® - «io)l \g(x -n<0 + «)| - 
* „ 


As in the wav^et c^e, sufficiently fast decay on g leads to dec£Qr feff so 这 tat 


by choosing u；o sm&ll enough, the secoiid terms in the rlg^t-faand Aides of (3.4.3), 
(3.4.4) can be made arbitmUy smaQ. H \g(x - nt®)p is boitfMkd, 


bouaded below by a strictly pomtive constant (no H ccms|Hring n the ^eros of 
til 挪 this implies that t&e 細 , A ccmstitute a &a_e for sufficbslly 啦 all 咖 
frame bon^te by (3.4.3), (3*4.4). Ebqpdld %， 撕 have the following 


pre^odti 

PilOl 


POSITION 3.4.1. If g, to are such UuU 


oM, ^ 


»<o)l 2 > 0 * 
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and if p(s) - Ip ( 盂 — ^o)| fe(x — nt 0 + s)\ decays at least aa 

fast (1 + vnth c > 0, then there exists (c^o)thr > 0 so that the 

p m>n (x) 3= g(x - nt 0 ) constitute a frame Whenever a^) < (u^o)thr For 

wo < (u^)tiir, right-hand stdes of (3.4-3), (3,4.4) are frame bounds for the 
9m f n* 

The conditions on (3 and (3.4,5) are met if, e.g” ig(ar)| < C(l + |xj) -1r with 

7 > 1 . 

， Remark. The windowed Fourier case exhibits a aymn^try under the Fourier 
transform absmit in the wavelet case. We have 

(<?m,n) A (0 = e~ ,ttt6€ gii - muo ), 

which impU^ that (3.4 3), (3.4.4) still hdd if we replace g, uo t by 9, ^Oi u ； o> 
respectively, everywhere in the right-hand sides (including in thje definition of 
/?). Using this remark, we can therefore compute two estimates each for A and 
B, aiui pick the highest one for A y the lowest for B 口 

3.4^3. The dual frame. The dual frame is again defined by 


4 ^ere FIs now (F*F)/ = {/, g m , n ) p m , n . In this case one easily checks 

if, 姑 lat F*F commutes with translations to as well as with multiplications by 

:， U” if (r/)(x) = /(x-M, (Ef)(x) - ^*/(x), then 


TF*F t 


EF m F . 


P follows that ( 尸 *F) 〜 1 also commutes with E and T % so that 

R f^n = (F*FY l ET T" 9 

K = ^ ^ ( F * F l~ l 9 > 


tp = e ，mwoX 9^ - nh) - g mt nM > 

g = (F*F)^~ 1 g. Unlike the generic wavelet case, the du&l &&me is always 
l^prated by a single function g. This means tEat it is not as important in the 
^^(feiwed Fourier case that the frame be dose to & tight frame: if B/A - 1 is 
^QHd^igLble, then one simply computes g to high pcecision v once and for all, 
wcwks with the two du&l &ames. 


Examples. 


♦flight frames with compact support in time or frequency. The fol- 
construction, again &om Daubediies, Grossmsmi, and Meyer (1 娜 ), and 
fliroilftr to S3.3.5.A, leads to tight windowed Bburier frames with arbitrarily 
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high regularity if cjot。< 2tt. If support g C , 


念 j ， then 


El (/ 知 H 2 



where we have used that for any n, at most one value of £ can contribute, because 
of the support property of g. 

Consequently, 、 

E W ，5 m , n ) I 2 = 芊 /" rfx 1/ ⑷ I 2 E 响 — 咐°)| 2 ， 

m,n ® ^ n 

and the frame is tight if and only if |^(x-nt 0 )| 2 = constant. For instance, if 
(j^oto > 7T, th 挪 we can start again from a C k or C°°-function v satisfying (3.3.25) 
and define 

， < x < ^ ^ 

^ -<0 < ^ < -^ +«o , 

otherwise . 

Then ^ is a or C°° function (depending on the choice of i/) with compact 
support, H^ll = 1, and the g m , n constitute a tight frame with {rsune bound 
2 丌 (wo^o.)— 1 (as already followed from (3.4.2)). If u；oto < then this construction 
can easily be adapted. This construction gives a tight frame with compactly 
supported g. By toeing its Pburier transform, we obtain a frame for which the 
window function has compactly supported Fourier transform. 12 

B. The Gaussian. In this case g(x) — 7r _l/4 e - * 2 / 2 . Discrete families of win¬ 
dowed Fourier functions starting from a Gaussian window have been xiiscussed 
extensively in the literature for many reasons. Gabor (1946) proposed their use 
for communication purposes (he proposed o»oto = 27r, however, which is inappro¬ 
priate: see below); because of the importance of the “canonical coherent states” 
in quantum mechanics (see Klauder and Skagerstam (1985)) they are of inter¬ 
est to physicists; the link between Gaussian adherent states and the Bargmann 
space of entire function makes it possible to rewrite results concerning thte g m ^ n in 


^(x) = t 0 


1/2 


1 ； 

cos [f-(^fe)] 
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terms of sampling properties for the Bargmann space. Exploiting this link with 
entire functions, it was proved in Bargmann et al. (1971) and independently in 
Perelomov {1971) that the g mr n span all df L 2 (R) if and only if c^oto < 2tt; in 
玆 aery, Grossmann, and Zak (1975) a different tedmique was used to show that 
if u/o^o — 27r, then 

inf il/ir 2 I ： l(/^m,„)| 2 -0, 

f^o m y n 

t 

even though the are u a>mplete, M in the sense that they span L 2 (R). 13 (We 
will see m Chapter 4 that this is a difeet consequence of a>o and of 

the regularity of both g and 々 •) This is therefore an example of a family of 
g m ^ n whem the inner products (/, g m , n ) suffice to characterize the function of / 
(if (fir 9m t n) - (, 2 ， 9m,n) for all then fi = / 2 )，but where there is no 

numeric^tly stable reconstruction formula for / from the (/, 5 m ，„>. Bastiaans 
(1980,1961) has constructed a dual function g stich that 


(/’ 3m,n) §m t 


g m ,n{x) — e * mwoJ： — tiIq), but GOBvergpnce of (3.4.6) holds only in a 
^l^ery weak Sease (in the sense of distribirtioi^-—sec Janssen (1981, 1984)), and 
/ mot even in the weak L 2 -sense; in fact t g itself is not in Z/ 2 (R). 

The case — 2?r is thus completely understood, what happens if uot Q < 
i 2 貫？ Table 3.3 shows the values of the frame bounds B and of the ratio B/A % for 
various values ofu；o io, computed from (3.4.3), (3.4.4) and the analogous formulas 
I using g. We find that the g m ^ n do constitute a frame, even for u；o • io/{2 丌） =.95, 
I ^though B/A becomes very large so close to th 矣 “criticaT density. It turns out 
% that when (Jo . to/(2ir) = l/N^ N ^ H, N > the frame bounds can also be 
computed via another technique, which leads to exact values (within the error 

K 0ff computation) instead of lower, respective^ upper, bounds for A,B. 14 For the 
多 jhoices a;。■ <o/(2tt) = | and 晏 ， Table 3.3 reveals these exact values as well; it 
surprising to see how close our bounds on A, B (which are, after all, obtained 
Cauchy-Schwarz inequality, and migjtit therefore be quite coarse) are to 
cact values Substituting these Values for A t B into the approximation 
Le at the end of §3,2, we can compute g for these different choices of ljq, t 0 - 
s 3.6 shows plots of g for the sped 縊 case where o； 0 = = (A 27 T) 1 / 2 , with A 

j the values .25, .375, .5, .75, .95, and 1. Note that Bastiaans' function g, 
corresponds to A = 1 (lower ri 卓 it plot m Figure 3 6)，has to be computed 
;ntly t since j 4 = 0 for A = 1. For small A, the frame is very close to ti^it ， 
is close to g itself, as is illustrated by the near-Gaussian profile of g for 
!5. As A increases, the frame becomes both less redundant (as reflected by 
owing maximum amplitude of g) and less tight, causing g to deviate more 
tore from a Gaussian. Because both g and g have (faster than) exponential 
one can easily prove from the converging series representation for g (see 
that g and g have exponential decay as well, if A > 0. It follows that 
l 你 e g mtn have good time-frequency localizati<m prq^erties, for all the values of 
^ A < I in Figure 3.6’ even though it is quite striking how g tends to Bastiaans' 



Fig 3 6 The dual frame function g for Gaussian g and u^> = = (2irA^ 1 ^ a / wtfh 

A = 25, .375, 5, 75, 95, and 1. As X increases, g deviates more and more from a (?aus3tan 
{reflecting the mcTease of B/A), and tts itmphtude increases as well (because A+B decreases). 
For X ~ 1, g is no longer square mtegn^le. 

pathological g as X increases. For A ~ 1, all- time-frequency localization breaks 
down. 15 The series ofplots in Figure 3.6 suggests the conjecture, first formulated 
in Daubechies and Grossinann (1 膊 8), that, at feast for Russian the^n are 
a frame whenever uJot Q < 2ir. In Daubechies (1990) it was shown that this 
is indeed the case for u) 0 to/(2ir) < .996. Using entire function methods, this 
conjecture has since been proved, by Lyubarskii (1989) and independently by 
Seip and Wallsten (1990). ' 

There exist of course many other possible and popular choices for the window 

function g, but we wiJl stop our list of examples here, and return to wavelets. 

* * 

3.5. Time-frequency localization. 

One of our main motivations fw studying wavelet transforms (or windowed 
Fourier transforms) is that they jm>vtde a time-frequency picture ， with, h<^e- 
fully, good localization properties in both variables. We have ass^ted several 
times, that if ip itself is well localized in time and in frequency, then the frame 
generated by ^ will share that property. In this section we want to make this 
vague statement more precise. 

For the sake of convenience* we assume and |^| to be symmetric (true if, 
e.g., ijj is real and symmetric—a good example is the Mexican hat function) 16 , 
then ^ is centered around 0 in time and near 土 (o in frequency (with t e‘g” 4b = 
/o°° 來《 I 苓 (OI 2 /[J 0 °° 來 l^(OI 2 ])* 肚 & well localized in time and frequency, then 
^iU similarly be well localized around a^nbo in time and around 土 
in frequency. Intuitively speaking, {/, ^ m ,n) theu represents the ^information 
content” in / near time a^nbo and near the frequencies 土 do. If / itself is 
“essentially localized” on two rectangles in time-frequency space, meaning that, 
for «ome 0<fto<fii<oo,0<!T<oo ， 



u>oto = 3ir/4 
A B B/A 


^exact Bf A 


3 546 

3.546 

5 901 

2.482 

2.482 

1 635 

2.425 

2.425 

1 539 

2.843 

2.843 

2.426 

3.387 

3.387 

4 752 


赏 /2 

^exact ^ 


to 


A 


10 

15 

2.0 

2.5 

3.0 


0 601 
1 519 
1 575 
1 172 
0 713 


to 

To 

1 5 
20 

2 5 
3.0 
35 
4.0 


~ ^exact S^A 
7.09t 5.896 

4.147 10T6 

4401 1.052 

4*679 1.408 

5.664 2.395 

6.772 4 745 


to A a 


0.5 1 203 

1.0 3 853 
1.5 3 899 

20 3 322 
25 2 365 
30 1 427 



Woto 


to 

A 

B 

B/A 

1.5 

0.031 

2.921 

92.935 

2,0 

0.082 

2.074 

25.412 

2-5 

0,092 

2.021 

22,004 

30 

0.081 

2.077 

25.668 

3.5 

0.055 

2.218 

40.455 

4.0 

0 031 

2.432 

79.558 


ufoto = 3ir/4 



to 

A 

B 

B/A 

10 

1.769 

3.573 

2.019 

15 

2:500 

2833 

1 133 

20 

2.210 

3 124 

1.414 

25 

1 577 

3.776 

2.395 

30 

0.951 

4.515 

4 745 
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Table 3.3 

Vaiues for ihe frame bounds A, B and thetr ratio B/A for the case ff(s )= 霄 -1 , 4 exp(— i 2 /2), 
for different values of ufo, to For c^o^o = tt/2 and ir, the exact vaiuea can be computed tna the 
Zak transform (aee Daubechtes and Grossfnann (1988))- 


3 2 2 4 3 0 8 

58 - 085983 - 95 - 88061 

丨 7 - 3 - 3 - 5 - 11 - 28 - 


-545S.340656014 

2 - 2 - 2 ' 2 - 2 - 3 - 

27428254932405 
0 3 5 5 3 2 1 

Qo.o oo.o.o. 


姓 601540600178713 

o 1 1 1 o 


sip 

7.44.4.5.6 

ss 

1 P63.3 2 1 




ij. 
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/ d^\m\ 2 >(l~S) |i/|j 2 

f dx\f(x)\ 2 >(l~S) |j/j | 2 , 


(3.5.1) 

(3.5.2) 


where 6 is some small number, then this intuitive picture suggests that only 
those {/, tp mt n) corresponding to m,n for which (a^nfeo, 土 lies within 
or dose to [~T t T] x (|—-Qo) U [Q 0) Oi]) ar« ^needed to reconstruct / 
to a very good approximation. The following theorem st^es that this is indeed 
trde, thereby justifying our intuitive picture. 

Theorem 3.5.1. Suppose Uwt the ^ m ^ n {x) — m/2 — nbo) consti¬ 
tute a frame with frame bounds B，and suppose that , 


|^(x}| < C(l + z 2 )- 吧 m)\ < C\^f {1 + f r (〜)/2 , ( 3 . 5 . 3 ) 

with at > 1 , ^3 > 0 , 7 > 1 . Then, for any € > 0 , there exists a finite set 
B e (O 0> Oi ； T) C Z 2 so that, for all fe L 2 (R), ^ 


f - (/» ^m,n) ^to, 

, \ 1/2 

^a/^ii / mmf 2 ) + 


V![( 


4 or |ff>Oi 




\.l /2 

dx\f{x)\ 2 ] + ell/ll 


(3.5.4) 


Remarks. 


1 . If / satisfies (3.5.1) and (3.5.2), then the first two terms in the right-hand* 

• side of (3.5.3) are bounded fay 26 j|/||; choosing e = 6 then leads to 

11/ - Ylm,neBt ^m,n) ^m,n|| — ^(^)- 

2. As €-+ 0 , # B e (f2 0 » Hi ； T)—kx> (see proof, below)：.infinite precision is only 
possible if infinitely mdny {/, i^rn t n) are used. □ 


Figure 3.7 gives a sketch <rf the set Hi ； T) for one particular value of 

e; the proof will show how we obtain this shape. 


Proof. 

1 . We define the set B £ as 

B t {U 0i Hi ； r) = {(m,n) € Z 2 ; mo |n6o| < a^T-^-t} , 

where m 0> mi and t, to be defined below, depend on fto, 0j, T t and €. The 
points «n 6 o, 土 d。} corresponding to (m, n) in such a set, do indeed 
fill a shape like Figure 3.7. 
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F»G. 3.7. The set of "u/avelet lattice points" needed for on approximate 

>nsttuctton of f if f ts localized mostly tn [—T,T^ in time and tn [—fti, —Qo) U [Oo,rZi] m 
uency.. ■ 


2 . 


(m,n)€B* 


m,n 


sup 

陶 | = 1 


sup 

UMM 


if.h)- (/» h) 

(fn,n)€5 e 


(/’ 岭 m ， n 》 ( 步 m.»，M 

(m,n)^B e 


^ E E 

IWM m<m 0 n€ 2 

or m>»n 丨 

(K^o.ni/) VVn,n)| + 1((1 - P«o ， ni)/ ， 分 m ， n}|l KV^m.ni ^)| 

SU P S II 


IMI-i 


rno<m<mi 


IKQt/, ^m,n)| + K(l- Q T )f ， ^m,n)|] |«„ ，叫， 

( 3 . 5 . 5 ) 

where we have introduced (Qt/)(x) — f(x) for jxj < T, (Qrf)(x) = 0 






90 


CHAPTER 3 

otherwise, and (Pn 0t aJ) A (0 = f(0 if < |^| < (Pn 0 ,n,/) A (0 =0 

otherwise. Since the ^m.n constitute a frame with frame bounds 
v(e have 


E 'EKC 1 - iWZn, h)\ 

n " €z 

,” \ 1/2 

< 一 


E |«1 - Pa^L Ul 2 ) fe 1^ 

m,n / \TA,n 

1/2 

/! 


1/2 


W 2 


<^ 1/2 IKi-^na/M ' 172 IN 

1/2 ' 

处 l/(OI 2 | (because I 网 =1) • 


i€l<«0 


Similarly, 


sup E ⑹ 1 - Qr)/ ， Uld ,«， 叫 


IIMI=i 


|„6 0 [> a - m T+( 


0 \L 


dx\f(x)f 


1/2 


It remains to check that the other two terms in (3.5.5) can be bounded by 

作 ll/ll. 


3. By the same Cauchy-Schwarz trick, we reduce the remaining two terms in 
(3.5.5) to 


fl/3 




1/2 


+ 


1 / 2 , 


E E I 财 ^)! 5 

[mo<m<mi J«* 0 j> o ^ m T+t 

(3.5.6) 

It is therefore sufficient to ahow that for appropriate mo, mi, t each of the 
expressions between square brackets is smaller than Be 2 ||/(! 2 /4. 


4. We tackle the first term In (3.5.6) by the same technique as in the'proof of 
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Proposition 3.3.2 ： 


E E ^.n)| 2 


^ I ： E 


炎 \f(0\ 


H tet 

> 1 % 引卜…列 


( 卜卜 - 




卜 W 




炎 l/(Oi : 


teZ L oo^ttisnj 

n 0 <l€-2ir£^ m 6- l j<O 1 

. 乙 W<^)I 2 " A 1^(^ 

m<mQ \ 

m>wij 


<k mof 


^0<Ki<O x 

n 0 £ic+3W«Q m b~ l i<nj 


Y1 l 々 ( 《 +p)l A MW01 2 - A ， (3.5. 

or m>mj 

where 0 < A < 1 will be fixed below. Since [1 + (w - s) 2 ] 

(1 + s 2 )[l + (u + ^) 2 )" 1 is bounded uniformly in u and 5 , we have 


m<^o\ 




%C\\ + (a^0 2 )^ /2 1 + 


<Ci(l+/ 2 )-^ 2 . 
Substituting this into (3.5.7) we find 

(3.5.7) sgCaljPoo^/ii 2 


X> + 1 2 )^ 12 sup Y, 1^WOI 30 ' A) - (3-5.8) 


no<iei<o» 


The sum over i converges if 7 入 > 1, Le., if A > 1 / 7 ; we can choose, e.g .， 
A = |(1 + 7 _1 ). On the other hapd t for flo < 1^! < 

t l^««| 3(1 ~ A) < Oz Y1 (i + <*o m ^r 7(1 T A) 

m>mi m>m\ * 

< C 4 n^ 37(x ~ A) ^ 2mi7(l_A) (3.5.8) 
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m<mo m<mo 

< C 6 Qf (, - A) a 5 mo/J(1 ~ A) . (3.5.10) 

In all these estimates, the constants C 3 may depend on ao, feo, A, /?, and 
7 but are independent of D 。， fii ， mo, and mi ，Substituting into (3.5.8), 
with the choice 入 = 5(1 + 7 _1 ), leads to ' 

(3.5.8) < c 7 (i/ii 2 [(n 0 o-(”” + 严”叫 . 

If mi > (Inao) -1 ((7 -l)** 1 In(4C 7 /Bc 2 ) - lnn 0 ] and mo < (In ao) _1 
[7^ _1 (7 - l)' 1 In (B€ 2 /4C 7 ) - hi fij], then this leads to 

E EU, ^ t ,n)| 2 < B € j ||/f , 

: d nez — 

as desired. 

5. The second term in (3.5.6) is easier to deal with. We have 

E ⑽ ^.n)P 

|nbo(>ao m r+( 

< E l!/f WQt ^,„|f 2 - 

JnM>o- m T+( 

< ll/ll 2 / dxa^ m [ ma^x - n*o)| 2 • 

，X| - T )n6o|>o 0 " w r+( 

The sum over n splits into two parts, n > b^ 1 {aQ m T + t), and 
n < *-bo 1 (°o m ^ T '+ 0* Let nj be the smallest integer larger than 
6o 1 (ao m r + t). Then . 

ao m f ^ Yl |^(a^ m a; - nM 2 

J ^ T n6 0 >a--T-ft 

< / dx J2 °s {i 4- [t + (n - m)bo + % m {T - x)] 2 }"° 

n=»m 、 

(because Jo^ m i - n6o( = nbo - o^ m a: > (n - ni)bo 4* 
t + a^ m {T-x)) 

< f；[i + (e + ^) 2 r a <C 10 r 2 v 

t=Q 
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The sum over n < -6p 1 (o^ is dealt with in the same way. It follows 

that 

E E ^m,n >| 2 < ^rm-mo + lj^o r 20 ll/ll 2 , 

moXm! \rtb(,1i>a- m T+t 

which can be made smaller than B e 2 ||/|j 2 /4 by choosing 
f- ^ [8( 爪 1 一 mo + 1)Cjo . 


This concludes the proof 


The estimates for that follow from this proof are very coarse; in 

practice, one can obtain much less coarse values if 0 and ^ have faster decay 
than stated in the theorem (see, e.g., Daubechies (1990), p 996)* 

For later reference, let us estimate # B ( (Qq, Di ； T), as a function of 
H 1} r, and f We find 


# B e (n 0 > Hi 


E 2b o l 


2b^ l T ^~^ — + - mo + l)t 

ao — 1 

2TC u bo l (ao-ir 1 f 2/{y ~ l) (Oi - H 0 ) 


+2e—" 0 feo^ln ao)~ (2o+1)/2fl C 12 [C 13 + to fii - In n 0 ] {2a+1)/2a . 

On the other hand，the area of the time-frequency region [~T,T] x ([-fii, Oo)U 
[rto T fti]) is 4T(fli - Qq) As Qo—O and T ， fii—» oo, we find 


I, 

^Miduch is not independent of e. We will come back to this in Chapter 4. 

Theorem 3.5.1 tells us that if 矽 has reasonable decay in time and in 
^^Nquency, then frames generated by ^ do indeed exhibit time-frequency io- 
^^#ftHzation features, at least with respect to time-frequency sets of the type 
x ([-n 1( -fio} U [flo, f2i)). In practice, one is interested in locali^ 
^®ron on many other sets. A chirp signal, for instance, intuitively corresponds to 
% diagonal region (possibly curved) in the time-frequency plane, and it should be 
^teible to reconstruct it from only those 岭 m , n for which (oo*n6o, m ^o) is in 
4»i€loBe to this region. This turns out to be the case in practice (for chirp signals, 
many others). It is harder to formulate this in a precise theorem, mainly 
—ettaae one first has to agree on the meaning of “localization” on a prescribed 
激 BM^firequency set, when this set is not a union of recteuigles as in Theorem 3-5.1. 


# B e (Q 0 , n 1； T) 
4r(fD 


boHao-iy 


(3.5.11) 


i back to this in Chapter 4. 
reasonable decay in time and in 
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If we choose the interpretation in terms of the operators Ls defined in §2.8 (i.e .， 
/is mostly localized in S if ||(1 — Is)/ll 《 11/11)，then the theorem is almost 
trivial if the wavelets in the definition of Ls and in the frame both have good 
decay properties. For any othdr time-frequency localization procedure (e.g. ， us¬ 
ing Wigner distributions, or the affine Wigner distributions of Bertrand and 
Bertrand (1989)), we still expect results analogous to those in Theorem 3.5.1, 
but the proof will depend on the chosen localization procedure 

An entirely similar localization theorem holds for the windowed Fourier case. 

Theorem 3.5.2. Suppose that the g m ,nM = e trmi ， oX g{x — nto) constitute a 
frame with frame bounds A, B, and suppose that 

i^)i<c(i+ x 2 r a/2 、 \m\<c(i+er^ 2 , 


mth a > 1. Then, for any c > 0, there exist > 0, such that, for all 

f e L 2 (R), and all T,Q>0, 、 



lr,t 0 |<T+*« 


{/t 9m y n) 9m 




< 



1/2 


r IO>« 


炎 1/(01: 


Proof. 


By the same tricks as m points 2,3 of the proof of Theorem 3.5.1, we have 

/ — (ft 9m y n)9m,n 

|mwol<n+w c 
|nt 0 |<T+t, 

</f (ll(l-0r)/|| + 11(1-Pn)/!!] 


+ A^ 2 i 


1/2 


+ 


E E ㈣ u 2 : 

n€Z jmw 0 |>n+w« - 

_ 

E _ ，細 ， 』 2 i 

meZ jntol>T+t« J 

’ {3.5.12) 

where (Qt/)(x) = /(a:) for |x| < T, 0 otherwise, 姐 d (Pn/) A U) - f(0 f° r 
Ifl <0,0 otherwise. The theorem follows if we <»n pnwe that the last two 
terms in (3.5.12) can be bounded by B 1/，2 cjj/||. Let us first concentrate 
on the last term. 
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E E I ㈣ 

m€Z |ntot>T+l« 


< 


2tr 

u^o 


EE/ ^t/(x)t |/(-^) 

|>T+t e /eZ |.*|<r 1 X 0 7 

1 *- 筇 *IST 

jp(x 一 nto)\ Jp 咖 ) I 




lw+ 


J dxmx)\ 2 E \9(^~nt 0 )\ 

*t<r jntol^T+i, 

| p ( x 一》 _—)| 

M - 

/ dy\f{y)\\ Y, 

v\<T jnto|>r+t« 


9 G + 盖 £ - n M)| — n^o)| 

< ^ WQrfW 2 Y1 ^2 sup I 咖 -nto)| 

0 Intoi^T+i, 


( 2lt s 、 

9 ( x - /-nto 

V > 


$ > 2 C H _ •暴 11+( 一 ) ” /2 


t<T 


l+(x-~i-rao 
\ wo / 


-o/2 


(3.5.13) 


One easily checks that the contribution for n > l (T + i e ) is exactly eqiuJ 
to that for n < J (T + i e ); we may restrict ourselves to negative n only, 
at the price of a factor 2. By redefining y = tiitia positive, we see 

that we may restrict ourselves to negative t as well. Hence 

(3*5.13) < C 2 ll/ll 2 E - 

^ |«*ol>T+t« t>0 • 

sup [1 + (x + nto) 2 ]~ a/2 

l*l<T 




-a/a 
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S c 2 w 2 ee 


[l + (n(o~T) 2 )- a/2 


1 + U«o - T + 


2itt 


i^o 


t/2 


.(3.5.14) 


^-0 


However, for any /i, i/ > 0, we have 

(1 + (/i + ^)T a/2 . 

< (i + /i 2 r a/2 + jT° dx [i + (p+ l/I) 2 「 a ’ 2 

<(1+ M 2 r a/2 + T( 2X - l^°dy (vTT^ + y y Q 

(use a 2 + 6 2 > i(a + b) 2 ^ 

< (1 4-/x 2 ) _a/2 + 2 a/2 u~ l {a - 1) _1 {1 +// 2 )~ a i 1 


it follows that , 

<3.5.14) < - C^l/f [ U + ( 峋 - r) 2 j_ a+ " 2 . 

nt 0 >T+t t 

Let rii be tho smallest integer larger than T 十 ％, Then 

Yl [l + (nt 0 -T) 2 r a+i/2 

nto>T+l, 

' < £ [1+ ((n-m)io + <e) 2 r 0+1/2 

n=m 

<c 2 (i+f?r a+i 

by the computation above. Putting it altogether, we have 

E E K^TAflm,n)l 2 <C 3 (1 + ^)-° +1 ll/H 2 , (3.5.15) 

meZ )nto|>T+t« 

where (7s depends on a^to’c*，and C, but not on T (or R). 

3. Similarly, one proves 

E E l( p n /， 5m.n)| 2 <C 4 (1 + ^)~ Q+1 ll/l! 2 . (3.5.16) 

Since a > 1, it is clear that expropriate choices of t € ,w € (independent of 
T or fi!) make (3.5.15), (3*5.16) smaller than Be 2 ||/|| 2 /4. This concludes 
the proof. ■ 
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Figure 3 8 gives a sketch of the collection (m,n) such that \maJo\ < (7 + a/ e , 
I < T 4- f ei as compared to the time-frequency rectangle [-T, T] x [ 

The “€-box” has a different shape from that in Figure 3 7 



Fig 3 8 The set of latttce points B t needed for t^pronmate reconstructtorij via the 
windowed Fourier tninsform^ of a function localued moaUy tn [—T, T] m time and m 
知 frequency 


^ Let us compare again the number of points in “he enlarged box B e — 
\mwo\ < n + u/ € , |nio| <T-\-t t ] with the area of [-T,T] x [-Q, n], in, 
tfee limit for large T, 、 

> # B € (T t n) 〜 20^(0 十叫） 2t 0 ~ 1 (T-M c ) 

―—— — 4TQ 

In contrast to the wavelet case, this limit is independent of e We will come 
to the significance of this m Chapter 4. 


(woto)" 1 . (3.5.17) 


/ 3.6. Redundancy in frames: What does it buy? 

As illustrated by the different tables of frame bounds, frames (wavelets or win- 
dowed Fourier functions) can be very redundant (as measured by, e.g., 

* \ if the frame is dose to tight, and if all the fr»ne vectors are normalized). In x 
" ， applications (e.g., as in the work of the Marseille groups~see the papera of 

ir 
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Grossmann, Kronland-Martinet, Torresani) this redundancy is sought，because 
representations close to the continuous transform are wanted. It noticed very 
early on by J Morlet (private communication, 1986) that this redyndsuncy also 
leads to robustness, in the sense that he could afford to store the wavelet coeffi¬ 
cients 〈/， n 〉with low precision (only a couple of bits)，and still reconstruct / 
with comparatively much higher precision. Intuitively, one can understand this 
phenomenon as follows. Let: a frame (not necessarily of wavelets or 

windowed Fourier functions). If this frame is an orthonormai basis, then 

p ，、 n-*i 2 (j). {Ff) } = </, 

is a unitary map，and the im^e of H under F is all of If the frame 

is redundant, 4,e. f if the are not independent, then the elements of F7i are 
sequences with some correlations built intg them, and FH — Ran (F) is gk 
suhspace of £ 2 (,7), smaller tha^i i 2 (J) itself. The more redundant the frame is, 
the “smaller” Ran (F) will be. As shown in §3 2, the reconstruction formula 

朽 > A 

-甘 〜〜 ^ 

involves a projection onto Ran (F): it can he rewritten as 

卜尹 • Ff ， ‘ 

and F*c = 0 if r 丄 Ran {F). If the {f t <p 3 ) are adulterated by adding some 
to each coefficient (an example would round-off error), the total effect on the 
reconstructed function wouid be 


/approx - F m (Ff^a) 


Since F* includes a projecti<m onto Ran {F), the component of the sequence 
q orthogonal to Ran (F) does not contribute, and we expect t)/ 一 / ap prox|| to 
be smaller than jja||. The effect should become more pronounced the “smaller” 
Ran (F) is, i.e , the more redundant the frame is 

Let us make this more explicit with the two-dimensiortal frame used as an 
example in §3,2, and by comparing it with an orthonormal basis. Define U\ = 
(1,0), w 2 = (0,1), e Y = u 2l e 2 = ~^u x - e 3 = - |« 2 ； («i,« 2 ) 

constitutes an orthonormai basis for C 2 ， (ei,e 2 ,C 3 ) a tight frame with frame 
bound If we add a } € to the coefficients 〈 / ， u 3 ) % where a 3 are independent 
random variables with memi zero and variance 1, then the expected error on the 
reconstruction will be 



2 - 

户 i 



=e 2 E(ttf+o|) = 2e 2 


If we add a 3 e to the frame coefficients (/, e 3 ) t ，then 


£ 
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i 


We 






— E (aj + Q；2 + otg — Ot|Ot2 •" OC2 q 2 ~ <*10^3) 


which represents a gain of | over the orthonorma} case! 

A similar argument can be applied to wavelet or windowed Fourier frames. 
In order to confine ourselves to only fimtefy many ^*n,n or g m%ny we assume / to 
be “essentially localized” on [~T,T] x u (^ 0 ,^ 1 )] (wavelet case) 

or [-r.T] x {—ft] (windowed Fourier case), so that there exists & finite set 
B e (see §3.5) for which 



I/- E (f^m,n)^n\\<4fW 

(and similarly for the windowed Fourier case). Let us assume the fmme is al- 
roost tight, Vm,n ^ Adding a m , n & to every (/, under the 

assumptions E(Q m ,„ - 6 mm >6 nn ' y E(a m , n ) = 0, leads to 

~ 〉■: ({/* ^m,n) + 

<e 2 H/l! 2 + <^ 2 (# B t )A^ 2 (3.6*1) 

If we assume || 分 m ， n || = 1). If we "double the redundmicy” by halving bo, then 
the new frame would again be almost tight (see, e.g., (3.3.11), (3.3-12)), with & 
frame bound A! twice as large ； on the other hand, the new “e-box” B: would 
contain twice as many elements. It follows that 

(# B f f )A~ 2 = A (# 氐 ) 4 - 2 ， 

i.e.，doubling the redundancy leads to halving the effect of adding errors to the 
wavelet coefficients. The same argument can be made for the windowed Fourkr 



>i 


case. 


As it stands, the argument above is rather heuristic. There are indications 
^so that it can be considerably strengthened: the gain factor observed by Mor- 
tet was in fact larger than what would follow from these arguments. More- 
% Over、recently Munch (1092) showed that for tight windowed Fourier frames 
with A = (2 貫 ) _1 u；oio = N~ l t iV e N, AT > l t the gcdn factor with respect to 
the orthonormai case is io fact N~ 2 t and not as would follow from our 
Mgument. His proof uses that A ' 1 is integer in an essential way, but it is hard 
to believe that the same phenomenon would not «xist for noninteger A 一 1 ; maybe 
it also holds ior wavelet frames! I put this ad a ch&llenga to the reader.... 




s 
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3.7. Some concluding remarks. 

In this chapter we have studied in some depth the reconstruction of / from the 
sequence ((/，where ip m , n (x) = < m/2 - nbo) (and varia¬ 

tions thereof 一 see §3.3.4). We have seen that numerically stable reconstruction 
is only possible if the ip m>n constitute a frame, and we have derived a reconstruc¬ 
tion formula if the are a frame. One can, however, use other reconstruction 
formulas (provided the 斗 m 、 n do constitute a frame: the necessity of that condi¬ 
tion remains!) To conclude this diapter, let me sketch the approach of S. Mallat, 
which addresses moreover the problem of shift-invariance. 

The discrete wavelet tfaisform, such as I have described it in this chapter, is 
highly non-invariant under translatioi^s. By this I mean that two functions may 
be shifted versions of each other, while their wavelet coefficie 说 s may be very 
different. This is already illustrated by the “hyperbolic lattice” 17 in Figure 1.4a, 
where the axis < = 0 plays a unique role. In practice one does not use an infinite 
number of scales, but cuts off very low and very high frequencies: only those 
m for which mi < m < mo are used. The resulting truncated lattice is then 
invariant under translations by (choose ao^ 2 for simplicity), which is, 

however, very large with r 然 pect to, e.g” the sampling time step for / (in most 
applications, / is given in s^npled form). If fi is a shifted version of / obtained 
by a translation / then typically the v^avelet coefficients of /i will be 

different from those of /o. Even if the shift is 亓 602 由 ， with m\ < m < mo, 
then (fi, ip m , n ) = (/ t V , m,n- 2 *~ ,n n) if m > m, but no such formula can be 
written for m > m. For some supplications (in particular, all applications that 
involve “recognizing” /) this can be a real problem. In a first approximation, 
the solution proposed by S. Mallat is the following: 

• Compute all the / dx f(x) ^(2~ m x-n2~ m bo) = a m ,n(/) (a special iff such 
as in §3 3 5.D makes impossible to compute these in C N log N operations, 
if / consists of N samples). This list of coefficients is invariant for shifts 
of / by nb 0 . 

• At every level m, retain only those a m , n (/) that are local extrema (as a 
function of n). This effectively corresponds to a subsampling of the highly 
redundant a m ,„(/). In practiw, the number of subsamples retained is 
proportional to times the original number; this is about the same 
number as one has in a not too redundant frame of the type described 
earlier, but the subsampling is now adapted to /, and not imposed a priori 
by the hyperbolic lattice. 

Together with this predcription for decomposition (here described in a sim¬ 
plified form) Mallat then proposes a reccmstruction atgorithm, winch works very 
well in practice (see Mallat (1991)). 18 In MaDat and Zhong (1992), the pnx»dure 
was extended to two dimensions, to treat images. One way to view Mallat’s ap¬ 
proach is to look upon the — n2— m feo) as the underlying frame (note 

that the change in normalization counters the larger number of frame vectors in 
every m-level). Again, it is necessary that this family satisfy the frame condition 
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(3.1.4) for a stable reconstruction algorithm to exist, but once this condition is 
satisfied, several reconstruction algorithms can be proposed In this case, Mal- 
lat’s extrema-algorithm is certainly more sophisticated than the standard frame 
inversion algorithm. 


Notes. 

1. If any / can be written as such a superposition, the are^also 

called “atoms,” and the corresponding expansions “atomic decomposi¬ 
tions. M Atomic decompositions (for many spaces besides L 2 (K)) have been 
studied and used in harmonic analysis for many years: see, e.g., Coifinan 
and Rochberg (1980) for atomic decompositions in entire function spaces. 

2. This is true except for very special 矽 .If the i> m , n constitute an orthonormal 
basis (see Chapters 4 and later), then the expansion with respect to this 
orthonormal basis provides a discrete “resolution of the identity.” 

3 - The polarization identity recovers {/, g) from ||/ ± ^||, ||/ i： ip|j: 

</， i [11/ + 卩 -11/ ~ 卩 "Mil/ + 0II 2 - «ll/ - 0II 2 ]. 


^ 4* That is, if (J„) ne j^ is any increasing sequence of finite subsets of J, i.e., 
Jn C J m if n< m, tending to J as n tends to oo, i.e., U ne j^ J n = then 
\\F*c — C J 0 f or n—+ °°* The proof is in two steps: 


• If n 2 > > no, then 

-sup m=1 

^ SU P|I/II = 1 


1/2 


^ 1/2 


1/2 


! fc 


which tends to 0 for n©—>oo. Hence the — Yi 3 ^j n constitute 
a Cauchy sequence, with limit ” in ^(R), 

For this r/，and any / G L 2 (R), 

(”，/) ~ lim n _ +00 (fimf) ~ linin-too ^, 3 ^j n c i (^j i /) 


Hence tj = 
is proved a 


F*c. j 
This is proved as follows： 

• {R(f + 9h f + 9)-(R(f-9), f-9) 

= 2W^) + 2{^,/)=4Re W， 5 ) 

(because R* R); 
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•Re W,9}<H^[||/ + # + ii/-ffll 2 ! = 5 L f^ll!/lt 2 + llfffi ； 
• \W,9)\ - (Rf t g) WJ)f\W,9)\ 

-W, {RL9)9im,9)\) ' 


<5 舊 ^ [ll/H 2 + !IW,^/IW,P>| j| 2 ] 

-， <5 f^ii!/it 2 +yi 2 ]； 

• ||H|j - su Plj/INli \(Rf,g)\ < f~4 . 

6. Intuitively, "C can be understood as a “superposition” of rank one 

trace-class operators (. ， h a ' b }h a ， b t with weights c(a ，6 ). If c is integrable 
mth respect to a~ 2 dadS y then the individual traces of {•, h a ' b )h a,b (which 
are all equal to 1), weighted by the c(a, b) are u summable, H so that the 
whole superposition has finite trace, " 

f°° da 

This handwaving argument can be made rigorous by approximation arlgu- 
ments. * ^ 

7, We use here the “essential infimum” (notation ： ess inf) defined by 

css mf f{x) - inf{a; |{y; f(y) > a}| >0}, 


where |4J stands for the Lebesgue measure of 4 C R. The difference 
between ess inf* f(x) and inf x f(x) lies in the positive measure require¬ 
ment: if /(0) = 0, f{x) = 1 for all x / 0, then mf x f(x) = 0, but 
essinf x f(x) — 1, tecause / > 1 except on a set of measure zero, which 
“does not count. 1 * In fact we could be pedantic, and replace inf or sup by 
ess inf onesssup in most of our conditions without invalidating them, but. 
it is usually not worth it: in practice the expressions we are dealing with 
are continuous functions, for which inf and ess inf coincide. In (3.3.11) the 
situation is different: even for very smooth the sum 2meZ W( a o*C)P 
is discontinuous at ^ = 0, because ^(0) — 0. For the Haar function, for 
instance, |V»(0J = 4(2 tt)’ 1 /2 | 矿 1 sin 2 4/4, and £ m€Z ㈤ ⑹ 卩： (2n)~ 1 
if ^ ^ 0, 0 if ^ — 0. We therefore need to take the essential infimum; the 
infiroum is zero. , 

8. This condition implies both the boundedness of YlmeZ W( a o l ^)l 2 and the 
decay of p(s): 


E ^ 

m€Z 


sup 


E iwoi 2 

m€Z 


< 


c 2 4 a 


0 oo . 

E a o™ + E 

m——<x> m 故 1 


<00 




and 
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sup y. \ii<^+s)\ 

l<l€l<oo meZ 一 

< c 2 sup {a? T aT (1 + 1<2《+ 5 | 2 广 (")， 2 

l<l«!<ao t 

+ E [(i + WCl 2 )(i + K$ + 5j 2 )] 

T7T—0 


■{l~a)/2 


In the fest term we can use that, for > % Ki + si > N-i > 
ted hems (1 + KC + ^l 2 )" 1 < 4(1 + |« 卩疒 \ for ㈤ < 2, (1 + |<C + 
sl 2 )^ 1 < 1 < S(1 + |«| 2 ) -1 . It folk 咖 that the first term can be bounded 
by 0*(1 4 - |aj 2 ) _ < 7_dl >/ 2 as soon as at > 0, 7 > a. Fot the second term 
we use that sup x (1 + y 2 )(l + (x - J/) 2 卜 1 [1 + (a? + |f ) 2 ] -1 < 00 to 
bound the sum by <7"(1 + | s p) 七 - ^^ o (i + 
wlme d < c < 1 is arbitrary. Since 1 < |CI < Oo, this cmi be bounded by 
C m {l 4 - if 7 > a. We have tterefore, for 0 < p < 7 — a, 

^><c(p)(i + w 2 r p/2 , 


ifp> L 

If ^ is continuous and has decay at cjo, then WC)P ^ continuous in 

Ct except at ^ = 0. There exists therefore a so that j 必 «$) 卩 $ |e 

if K - €o| £ a- Define, for o ; < a, a function / by /(() = (2a # )~ 1/2 if 
— ^jj < a\ /($) = 0 otherwise. Then 


E K/^ ( n)l 2 < 


m ， n€Z 


g W 1 


del^WOI m^ + 2irkb^)\ 




3 2tc 


E ( 2a ') -1 

Mto 

S 

炎 l^(o?C )] 2 


K-eois^ 

(use Cauchy-Schwarz on integral) 


定 4 
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< 


昏 f - 1 

E < f 成 \k<o\ 2 


<* + 2a f sup 一 Ol 2 • 

^ meZ 


If j^(^)| < C(1 + |^| 2 )~">/ 2 with 7 > 1. then this infinite siMn is oniformly 
bounded in 《， and we can cbcxise a 1 so that the whole ri 适 it hand-side of 
the inequality is < 2€. 


10. Bewaure of a mistake in the example on pp, 988-989 of Daubechrcs (1990). 
The formula for (/ioo) A should read (/ioo) A — YlJLo ^VjO, and leads to the 
conclusion that ^oo^L p (R) for small p. 1 would like to thank Chui and Shi 
(1991) for pointilig this out to me. 


11. This is slightly different from multiresolution auialysis，where (3.3.27) would 
also contain a scaling factor 2: 

k 


12. Ooe can sdso construct tight frames where neither g nor g have amipact 
support. It is, for instance, possible to construct a tight frame in which 
both g and g have exponential decay. One way of doing this is to start 
from any windowed Fourier frame, with window function g, and to define 
the function G = (F*F) -1 / 2 g, where F*F = E m ,n( The 

functions G m ,„(x) = e ,mu，oX G(x - hto) (same u ； o,fo as in the 3m, n ) then 
constitute a tight frame. One has indeed 

G --，«>| 2 = D 〈，， (^ Fr 1 / 2 9m , n)\ 2 

m t n m，n 

= E 9m,n)f 2 - ((F^F)(F*F)- l ^f, w 1/2 /> 

m^n f 

= il/i ! 2 • 

The explicit computation of G can be carried out by a series expansion for 
(F*F)~ 1 ^ 2 analogous to the series for (F*F)~ 1 in §3.2. If g and g have 
exponential ^ecay (in particular if 分 is Gaussian), then the resulting G and 
its Fourier transform have exponential decay as well. Fwr more details, 
plots of examples, and an interesting application, see Daubediies, Jaffard, 
and Journe (1991). 
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13. The proof in Bacry ， Grossmann, and Zak (1975) nsas the Zak transform, 
which we introduce and use in Chapter 4. Pull details of their argument 
are also given in Daubcchies (1990). It is interesting that their proof can 
be extended to show that the g min still span all of I 2 (R) if one (any one) 
of the is deleted, but not if two functions are deleted. 

14. These exact formulas use again the Zak transform. Their derivation is given 
in D^ubechics and Grossmann (1988); it is also reviewed in Daubcchies 
(1990). 

15. In wjme applications, Bastiaant** result is interpreted (correctly) to fneiirt - 
that one should “oversample” (i e.，choose u ； o*o < 2tt) in order to restore 
stability. NevertheleM, even in &uch an “oversampled” regime, sometimes 
Bastiaans' pathological dual function is still used (see, for instance, Porat 
and Zeevi (1988)). If tJoio = tt, then the g m ， n can be split into two families, 
g mt 2 n and p m ,2n+i) each of which can be considered to be a family of 
Gau^ian windowed Fourier functions with = 2 tt, one generated by g 
itself, the other by p(ar — <o)- For both families, the badly convergent (non- 
convergent in L 2 ) expansion (3.4.6) can be written, and a function can be 
viewed as the average of the two expansions This is of course true m the 
sense of distributions, and in practice reasonable convergence (probably 
due to cancellations) seems to be achieved (using a truncated version of 
Bastiaans 1 g- private communication by Zeevi (1989)), but far better time- 
frequeacy localization, and I suspect better convergence, in practice, would 
be achievable by using the optimal dual function g (corresponding to A = .5 

in Figure 3.6 in this case). 

16. This symmetry is certainly not necessary. , 

17. It is in fact a true hyperbolic lattice with respect to the hyperbolic geometry 
on both the pc^itive and negative frequency half plane. 

18. Note, however, that Y. Meyer has proved recently that the Q m , n (/) which 
are local extrema in the construction above do not suffice to characterize 
/ completely. 



CHAPTER 4 _ 

Time-Frequency Density and 
Orthonormal Bases 


This chapter splits naturally into two psuts. The first section discuss^ the 
role of time-frequency density in wavelet transforms versus wsidowed Fourier 
transforms. In partic\dax, for the windowed Fourier transform, orthonormal 
bases 鄉 possible only at the Nyquiat density but no sudi re^riction exists for 
the waveletr case This leads naturally to the second section, which discusses 
possibilities for orthonormal bases in the two cases. 


4.1. The role of time-frequency density in wavelet 
< Fourier frames. 


windowed 


We start with the windowed Fourier case. We mentioned in §S.41 that a family 
of functions {p m , n ; m,n 6 Z)» 

9m,n( x ) = e imwoZ g(x , - (4.11) 

cannot be a frame, whatever the choice of g f if • io > 2tt. In fact, for any 
^choice of p 6 L 2 (R), one can find / G Zr J (R) so that / ^ 0 but (/, pm,n) = 0 for 
^*11 m t n € Z. If, for instance, 吻 = 27r, 4 = 2, tk 如 such a fimctioa / is e&sy to 
^construct ： (/, 細 , n ) = 0 for all m, n G Z leads to 


0 


h 

/> 


e 2irtmx f(x) g(x-2n) 


/(: + 0 g(it + l~2n ), 
t£Z / 


u 黎 that it is sufficient to find / ^ 0 for whidi S( x + Q 9(^ + 豸 一 2n) 念 0 . 
； jJ>efiDe now, for 0 < x < 1, i € Z, f[x -f * 《一 l) 1 g(x — Clearly, 
|/(jr) 卩 = IZq^ ⑻ 卩，拟也站 / € 厶⑽ and / ^ tt However, 
f( x + £ ) 咖 ； UnJ = 卜 1 诉 -, ： 1 ) 穿 ^4*,;2n)，wiiich 
turns into its negative upon the substitution t = 2n - f 一 1, and th^efore 
I 鄉 ials zero. The same construction ca& be used for any other pair wo t to 
with product 4 tt ； a generalization of this eonstmction exists if • to > 2 tt 
ftftd is rational (see Daubecbies (1990), p, 978). If 0^ 紿 (2 贫) _1 is 

larger tbao 1 but irrational，thea I know of no explicit construction for / ^ 0, 
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/ 丄 9m,n- The existence of such an / was proved in Rieffel (1981), using ax- 
guments involving von Neumann algebras. 1 If only “reasonably nice” 分 are con¬ 
sidered (i.e., g that have some decay in time as well as in frequency), and if we 
are only interested in proving that the g m n cannot co 册 titute a frame (which 
is weaker than proving that there exists / 丄 g m n ), then the following very 
elegant argument by H, Land 仙 does the trick. If \g(x)\ < C{X + x 2 )~°^ 2 , 
lff(C)l ^ C(1 + 《 2 ) _a / 2 ，and the g min constitute a..frame, then Theorem 3.5.2 
tells us that functions / which aure “essentially localized” in [-T, T] x [~n,n] 
in the time-frequency plane can be reconstructed, up to a small error, by using 
only the {/, g m ,n) with |mo^| ^ U, |n«o| ^ T. More precisely, if / is bandlimited 
to [-fi,n] and if [/卜砂办 l/(x)| 2 ] 1/2 < c ||/||, then 

f - E (A p m ,n < 2c ^| ||/)| . 

|mu»0|<n+w c 

\nt 0 \<r^t € 

According to this formula, all such fiinctions can therefore be written, up to 
arbitrarily small error, as a superposition of the g m , n with |m| < a;: 1 (S1+ 办 ) ， |n| $ 
to^ 1 ^ + 办 ）， where 6 depends on the error allowed, but not on fl or T. However, a 
corollary of the work of Landau, Poliak, and Slepian (see §2.3) is that the space 
of functions bandlimited to and satisfying J^ >T dx |/( 怎)卩 S 7 ||/lf 2 

(0 < 1 < 1， 7 fixed) contains at least - Oflog (UT)) differtijft orthogonal 
functions (the appropriate prolate spheroidal wave functions). A11 these different 
orthonormal functions c 拙 only be approximated by linear combinations of a 
finite number of n if the number of § m ， n exceeds that of the orthonormal 
functions, i.e., if 27r _1 iTT-0(log (QT)) < 4a；o 1 to~ 1 (^ + ^)(T ， + 否 )， for any U,T. 
Taking the limit as Q, 7 1 —»oo leads to (2^) -1 < (u 0 to) _1 or u；oio S 2tt. (This is 
really only a sketch of the proof. For full technical details, see Landau (1989).) 

For all practical purposes we even have to limit ourselves to wo . to < 2 tt 
( strict' inequality) if we Want good time-frequency localization: frames for the 
limit case u；o • == 2 tt have necessarily bad localization properties in either 

or frequency (or even in both). This is the content of the following theorem. 

Theorem 4.1.1. (Balian-Low) If the g mt n{x) — e 2 ntmx g(x - n) constitute a 
frame for L 2 (R), then either f dx x 2 \g(x )\ 2 = oo or f 《 2 | 点⑹卩 = oo. 

Before proceeding to the proof of this theorem, let us review its hbtory, and 
add some remarks. Originally, the theorem was stated for orthonormal bases (in¬ 
stead of frames), independently by Balian (1981) and Low (1985). Their proofs 
are very similar, but contain a small technical gap which was filled by H. Coifizuui 
and S. Senunes; this proof can then be extended to frames as well, as reported in 
Daubechies {1990), pp. 976-977. Subsequently, a different, very elegant proof for 
orthonormal bases was found by Battle (1988), which was generalized to frames 
in Daubechies and Janssen (1988). (This is the proof we give below.) 

Two well-known examples of functions g for which the family e 2wimx g(x — n) 
constitutes an orthonormal basis are 


^ = { 0； 


0<x<l, 

otherwise 
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^ c 2fftma e~ 2nttn (Ze)(s t t ). 

• {Zt){sr,t) — 1 almost everywhere on JO, l] 2 . 

It follows that Z maps an orthonormal basis of L a (R) to an orthonormai basis 
of£^[0,l] 2 ) t sothatZ is unitary. We can extend the image of L 2 (R) under Z 
to a different space, isomorphic to L 2 ([0, l] 2 ). FVora (4.1.2), we find, if we allow 
(s,i) outside [0, l] 2 , 

(Z/Ks，< + l) = (Z/HM)， 


{Zf)(s + \,t) = e^(2})(s y t). 

Let us therefore define the space 2 by 

2^{F: R 2 —Q F(s ,t + l)=i F(M) ， F(s + ht)^ e 2 ， “F(M) 
and \\F\\l = |F(3,t)| 2 <oo}; ， 

then Z is unitary between Z 2 (R) and Z. The inverse m 叩 is easy as well： for 
any F g Z, 


and g{x) = . In the first case, f C 2 l5(Oi 2 = °°> in the second case 

f dx x 2 \g{x)^ = oo- It is shown in Jensen, Hoholdt, and Justesen (1988) that 
one can choose g with slightly better time-frequency localization: they construct 
g such that both g and g are integrable (i.e., / dx |^(x)| < oo, J |p(^)j < oo), 
but their dec^ is still rather slow, as dictated by Theorem 4.1.1. 

Note that the choice w 0 = 2兀，亡。 =1 in our formulation of Theorem 4.1.1 
is not a serious restriction; the conclusion hcdds whenever ■ to ^ 2?r, To see 
t^is, it suffices to apply the unitary operator (Uf)(x) — (2nwQ 1 ) 1 ^ 2 g{2nu；Q l x); 
即 plying" tog myn (x) = e tmu) ° x g{x-nt 0 ) one finds = e 2ntrnx {Ug){x~ 

n). 

To prove Theorem 4.1.1, we will use the so-called Zak transform. This trans¬ 
form is defined by « 

= ( 41 . 2 ) 

teZ 

A priori, this is well defined only for / such that Yi 1/(^ - 01 converges for all 
s, in particular for |/(a:)| < (7(1 + |a:J)~ <1+e, . It turns out, however, that this 
restrictive interpretation of Z can be extended to a unitary map from L 2 (R) to 
L'[0, l] 2 ). One way of seeing this is the following: 

• e m , n (ar) = € 2ir,mx e(x-n), with e{x) = hior 0 < a: < 1, e(x) = 0 otherwise, 
constitutes an orthonormal basts for L 2 (R). 

• (Ze m , n )(s t t) = Ze e{s-n-() 


毛 r ; l > ■二 f 署著，袭 I 稳 f 


(Z^FMx) - / dt F(x，0 , 
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if this integral is well defined (otherwise, we have to work with a limiting argu¬ 
ment). ' 

The Zdk transform has many besuitiful and useful properties* As is often the 
case with beautiful and useful concepts, it was discovered several times, and it 
goes by many different names, according to the field in which one first learns of it. 
It is also known as the Weil-Brezin map, and it is claimed that even Gauss was 
aware of some of its properties. It was also used by Ge^fand. J. Zak discovered it 
independently, and studied it systematically, first for applications to solid state 
physics, later in a wider setting. An interesting review article, geared mainly to 
applications in signal analysis^ Is JaaBsen (198S). 

Only two of the many property of the Zak transform will concern us here. 
The first is that if p m , n (x) == c 2 ^ tmx ^(x — n), then 

(Zg m , n )( 5 ,0- e^ tn (Z 9 )(s,t) 


(as we already showed above, in the special case g — e). This implies 


[K/^m,n)P= \{ZJ, Zg mt n )\ 2 (by unitarity) 

m,n€Z m,n€^ 


E 

m,n€Z 


Oil 


dt e 


—2n%m3 


e 2 " ,nt {Zf)(s t t) {Zg)(sj) 


= f l ds f l dt\{Zf)( S> t)\ 2 \(Zg)( S> t)\ 2 \ 

Jo Jq 

Equivalently, we have Z{F*F)Z~ l — multiplication by \(Zg)(s,t)\ 2 on Z, where 
F*Ff = J2m,n (/ » 9m,n) 9m,n- The second property we need concerns the 
relation between Z and the operators Q^P defined by ((J/)(x) = xf(x) r 
(Pf)(x) = (or, more properly, (_P/) A (0 ; One checks that 

[Z(Qf))(s } t) = d t (Zf)(s t t ), ' 

which means that J dx x 2 \f{x^ < oo, i.e., Qf € i/ 2 (K), if and only if ^(Z/) e 
L 2 ([0, l] 2 ). Similarly, /成 ⑹ | 2 < oo or Pfe L 2 (R) if and only if d a (Zf) € 
i 2 ([0, lj 2 ). We are now ready to attack the proof of Theorem 4.1.1. 

Proof of Theorem 4.1.1. 

1. Assume that the g m>n constitute a frame. Since 

* E K /， 9m , n )? = j^d8 £dt \Zf(s,t)\ 2 \Zg( Si t)\ 2 

and since Z is unitary, this implies 

0 < j4 < \Zg(s t t}| 2 <B <oo . 


(4.1.3) 
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The dual frame vectors 备 m ， n are given by 

9m, 9 m,n 

{see §3,2, §3 4 3). Since Z(F*F)Z~ l — multiplication by \Zg\ 2 , it follows 
that 

^9m t n ^ \^9i ^9m,n 

or 

(Zg m , n )(s,t) - \Zg(s,t)\~ 2 e~ 2 ^ tn {Zg){.%t) 


=e 2ff,ms c- 2 ** ln [^(M)]- 1 , (4.1.4) 

which is in Z by (4.1.3) In particular, (4.1.4) implies that 
9mA x ) = e 2irtmx g{x - n ), 

with Zg = l/^g. 

3 Suppose now that / dx a: 2 |^(x){ 2 < oo, / 成点 ⑹ | 2 < oc ， i.e.，that Qg, 
Pg G L 2 (U). This will lead to a contradiction, which will then prove the 
theorem Since Qg, Pg e L 2 (R), we have d a {Zg), d t (Zg) €. L 2 ([0, lj 2 ). 
Consequently, 

(%Zg = (TgY 2 dTZg and d t Zg = (Z~g)~ 2 ^Zg 
are m Z/ 2 ([0, l] 2 ); hence Qg, Pg G L Z (R). 

4 - (9, 9m,n) = (Zg, Zg„ hn ) 


^ f ds f l dt Zg(s,t) Z^i) 加華 e 2irttn - WnO ； 

- Ja Jo ^ 

similarly, . 

(fff 9m,n) = - (4.1.5) 

5. Since Qg, Pg € L 2 (R), and since the (細瘳 ) m 批 (5m,n) m ,neZ constitute 
dual frames, we have - 

(Qp, Pg) = 52 {Qb, 9m^\{9m t n, Pg) • 

m t n 


But (Qg, g mt n) = xg{x) e* 2 * 4m * |(i ~n) 

=J dx g(x) e _2lrtm * ( 宏一 g(x - n) 

(because (gj m ， n ); ^mo^«o) 

— Q9) • 
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Similarly, (y m , m Pg) - (Pg, p_ mi _ n ). Consequently, 

(Qg, Pg) = J2(P9, 9- m ^n)(9-m,-n, Qff) = (Pgr Qg) , (4.1.6) 

m,n 

* , 一 

where the last term is again well defined because Pg, Qg € X/ 2 (R), 

6. We have now reached our contradiction: (Qg y Pg) = (Pg 、 Qg) is im¬ 
possible. For any two functions f x , f 2 satisfying ]J^(ar)| < C(1 + x 2 ) -1 , 
\fAO\ <C(l+^ 2 y\weh&ve 
* - ^ 

(Q/u Ph) - JdxxMxJiW) * 

=~ Jdxi [xf[(x)^ fi(x)\ f 2 (x) 

=-i {/», f2) + (Pfu Qh). 

On the other hand, since Pg, Qg e Z- 2 (K), there exist g n satisfying 
!f/n(^)l < C„(l + x 2 ) -1 , |p„(Ol < +€ 2 疒 1 such that lining g n 二 g, 

lim n — % Pg n 二 Pg, Um „— 尤 Qg n - Qg. (Take for instance g n = 
(9 、 where /f* are the Herrnite functions.) A similar se¬ 
quence g n can be constructed for g. Then 

(Pg, Qg) = lim (Pg n , Qg n ) 

n—*oo 

=[{Qgny + i i9m pn}) 

= (Q9, Pg)+i {9^9 ) - 

Together with (4.1.6) this imjrfies {g,g) — 0. However, from (4.1.5) we 
have {g, g) = 1. This contradiction proves the theorem. 2 • 

We can summarize our findings so far as 

• woto > 2?r — * no frames. 

• u; 0 to = 2tt ― *> there exist frames, but they have bad time* 

frequ^icy localization. 

• (jj 0 to < 2 tt —~* frames (even tight frames) with excellent time- 

frequency localization are possible (see §3*4-4-A). 


This is represented in Figure 4.1, showing the three regions in the o>o,fo-plane, 
As pointed out in §3.4.1，orthononnal bases are only possible in the “border case” 
ujQto = 2v. In view of Theorem 4.1.1, this means that all orthonormal bases of 
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FlO. At 1 The regions u^jto > 2 霄 where no fmmea are possible, and < 2ir, where 
tight frxantg wtth excellent Ume-fr&fttency locaitzaU&n exist, are separat&i by the hyperbola 
a>oto = 2v, the only region where orthonormal bases are possible 


tibe type {p m , rt ; m,n € Z}, with p m ， n as is (4.1.1), have bad time-frequency 
localizatwn. 

In fact, uq - to is a measure for the "time-frequency density” of the frame 
cdnstitnted by the g m ， n . We can for instance define this “density” as 



li m # {(^>n); (mfa^ ， nto) € A5} 
*oo I 入的 


(4 17) 


where 5 fe a “reasonable” set in R 2 (with nonzero Lebesgue measure). This limit 
is independent of 5, and equal to (a> 0 - to) -1 - This “density” also emerged in 
the time-frequency localization discussion in §3.5; see (3.5.17). The restriction 
(wo _ fo)' 1 > (27t) _1 means that the time-frequmcy ilensity of the frame has to 
be at least the Nyquist density (in its “generalized” form; see §2.3). In fact, 
Theorem 4.1.1 tells us that we have to be Strictly ⑽ e the Nyquist density if 
we want good time-frequency localizatkm witlf #indawed Fourier frames. 

Let us now turn to wavelets, where the ffituation is very different. It turns 
out that thwe is no “clean” definition tim&frequency density for wavelet ex¬ 
tensions. We already saw a first indication of this in the study of the localization 
Operators in §2.8 ： for the windowed Fourier case, the number of eigenvalues in 
the transition region became negligible (as compared to the number of eigen¬ 
values close to 1) when the area of the localizatiop re^on tended to infinity, 
whereas these two numbers were of tlie same order of ms^piitude in the wavelet 
case. This made it impossible to make an accurate comparison with the Nyquist 
density. 

Something similar happens with discrete wavelet families. In the discussion 
of time-frequency localization with firames, in §3.5, we saw that a function that 
is essentially concentrated in [-T,T\ x ([—x [n 0 ,^il) in the time- 
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frequency plane can be approximated with good precision by a finite number of 
wavelets. Unlike the windowed Fourier case, the ratio of this number to the time- 
j&reqpency area 4T(Qi —flo) depends on the desired precision of the approximation 
(see*(3.5.n)), which makes it impossible (as in the continuous case) to meJce a 
precise coiqparison with the Nyquist density. On the other hand, if we try to 
define the analog of (4.1‘7) for the hyperbolic lattices of Figure 1.4a, then we 
find that 

rw'、# {( 汛 ， 《); (ma; 0 ,nto) € A5} 

Rs(X)s= - |A5| -- 

(where S is chosen so that the numerator is finite) does not tend to a limit 
as A-^oqu For S - [~T,T\ x ([一 2 mi , -2 m °] U [2 m °, 2 m »]) and a 0 = 2, 
for instance, Rs(X) oscillates between / >(1 - 2 m °~ mi ~ 1 )/(l - 2 mo_Tni ) and 
2/)(1 ― 2 m °" mi ~ 1 )/(l - 2 TUo_mi ) t where p depends ojn the chosen wavelet 
tp. It might be this phenomenon, rather than the absence of an Intrinsic 
time-frequency density few the frame, 矣 hat causes the problem in cou/iting the 
number of wavelets needed for time-frequency loealization. So let us probe a 
little deeper. 

As we mentioned before, there is no a priori r^triction on the range of dila¬ 
tion and translation parameters in a wavelet frame: any choice of ao,2>o can be 
used to define a tight frame with good localization in both time and frequency 
for ip (see §3.3.5.A). In fact, from a (tight) frame with discretization parameters 
ao,6o we can always construct a different ^tight) &ame with parameters oq, bo’ 
(same Oq) with arbitrary, by- simple dilatk)t}. 3 It is therefore not surprising 
that we have no a, priori restrictions on ao,^o- We can remove this diiationai 
freedom by fixing not only the lK^malization of ip, ||^?|| = 1, but by also im¬ 
posing a fixed v^ue for J |(| 一 1 |^(C)| 2 * For r 供 J 也 we could impose, for 
instance, / 0 °° 处疒 1 W ⑹卩 = / 二处阳一 1 W^)| 2 = 1- A tight frame gener¬ 
ated by a ^ thus restricted would aatomaticaJly have frjone bound A — 

(see Theorem 3.3.1). A compariao^ with the formula A = f OT tight win¬ 
dowed Fourier frames so^esta maybe (fcolna 。 ) 一 1 couJd play the role of 
time-frequency density for the wavelet case. The following example destroys oil 
hope iiitthis direction. In the neict section we will encounter Meyer wavelet 
ip; it has a compactly supported Fourier tr 拜 psform ip ^ C k (where kjnay be 
oo, as in §3.3.5.A; the two constmctioos 脚 related) and the = 2 _m/2 
ip(2~ m x - n), m } n G Z are ao orUioiiorQial basis for i 2 (R). Let us, for this 
chapter only, define * 5 

O) = 2-^ 2 t(2~ m x-nb), (4.1.8) 

where iff is the Meyer wavelet, and 6 > 0 is arbitrary. Consider the fe-4ependent 
families F(b) = m i n ^ Z}. As 6 changes, the “density” of the associated 

lattice changes as well. (Note that oq and ^ are the same for all the / ^(6)!) If 
any representation like Figure 4.1 held also for wavelets, then we woi^ld expect, 
since F(l) is an ortbonormal basis for X a (Ri，that P ⑼ would not span all of 
X 2 (R) if 6 > 1 (hot enough* vectcns), and that F(b) would not tie linearly 
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independent (“too many” vectors) if 6 < 1. Yet one can prove (see Theorem 2.10 
in Daubechies (1990), we also sketch this proof later in this chapter) that for 
some t > 0, F(b) is a Riesz basis for L 2 (R) t for aay 6 € ]1 - e, 1 + t[. This 
example shows conclusively that it is not always safe to apply ^ime-frequency 
space density intuition** to families of wavelet. 



4.2. Orthonormal bases. 

4.2.1. Orthonormal wavelet bases. The conclusion of the last paragraph 
seems a rather negative point for wavelets: no deem time-frequency density 
concept In this section we emphasize a much more positive aspect ： the existence 
of orthonormal Wavelet bases with good time-frequency locdiz&tion. 

Historically, the first orthonormal i^ivelet basis is the Ha^r basis, constructed 
long before the term ^wavelet” was coined. The basic wavelet is then, as we 
already saw in Chapter 1, 

[h 0<x<I , 

^(x}=< -1, \<X<\, (4.2.1) 

" \ 0 otherwise 

•We showed in §1 6 that the 妒 m , n (i) = n) conatitute an or- 

l^onormal basis for Z/ 2 (R). The Haar function is not continuous，and its Foturie* 
iransfonn decays only like cc»rrespoiiding to bad frequraicy localization. It 
may therefore seem that this basis is no better than the windowed Fourier basis 

9m,n(^ = ^ tmx 9^-n) J (4.2.2) 


with 



0<x<l, 

otherwise^ 


whidi is als6 an orthonormal basis for L 2 (R). However, theHam* beats already 
has advantages that this windowed Fourier basis doesn^ have. It turns out, for 
instance, that the Haai* basis is an unconditional basis for 1 < p < oo, 

whereas the windowed Fourier basis (4.2.2) is^not if 梦 # 2. 4 We will omie back 
to this in Chapter 9. For the analysis of smdoth^r functions, the discontinuous 
Haar bftsis is ill suited 

An orthonormal wavelet basis with properties compl@nentary 

to the Haar basis is given by the Littiewood^Pfiley <basis 9 

细={( 2 吒 1/2 , ' 

\ 0 ， otherwise 




i>{x) = (irx) -1 (am2frx ^simra;). 

It is easy to check that the ip m , n (x) — 2~ m/a - n) constitute indeed an 

orthonormal basis for X 2 (R). We have — 1 ^ or all m，n € Z, and 


Ei</u 2 =Z>)~ l2m 

in t n m t n 




叫 2 
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f 2 
= 53 (2^)- ! 2^ / dC /(2- m C) e mC - 

- EW l2 ' m [/(^ m C)X[,, 2 ,j(C) + /(2” m (C - 2ir)) X( o,,](C)]f 

m t n 

=E 2_m l/(2_ m <) 卟圳 (C) + /(2，(C - 2 貫 ) ） Xfo^tOI 2 

m Jo 

-E 2 " m /■ 成 i/(2— oi 2 - i/(oi 2 = ii/» 2 * 

rn ^»SiCl<2ir ‘ J-QO 

By Proposition 3.2.1, this implies that m,n G Z} is an orthonormal 

basis for L 2 (R). The decay of ^{x) is as bad {ip(x) ^ |:r| 一 1 for x~*oo) as that of 
the orthonormal windowed Fourier basis used in the Shannon expansion (2.1.1); 
both haro excellent frequency localization, since their Fourier transforms are 
compactly supported. 

In the last ten years，several orthonormal wavelet bases for L 2 (U) have 
been <x>nstmcted which share the best features of both the Haar basis 肋 d the 
Littlewood-Paley basis: these new constructions have excellent localization prop¬ 
erties in both time and frequency. The first construction is due to Stromberg 
(1982); his wavelets have exponential decay and are in C k (k arbitrary but fi¬ 
nite). Unfortunately, his construction was little noticed at the time. The next 
example is the Meyer basis mentioned above (Meyer (1985))，in which ip is com¬ 
pactly supported (hence tjj € C°°) and C k (k arbitrary, may be oo). Unaware at 
that time of Stroraberg’s construction, Y. Meyer actually found this basis while 
trying to prove & wavelet equivalent of Theorem 4.1.1, which would have sfaowxr 
the Qon*existence of these nice wavelet bases! Soon after, Tchamitchian (1987) 
constructed the first exunpie of what we shall call biorthogonal wavelet bases 
(see §8.3). The next year, Battle (1987) and Lemarie (1988) used very difier- 
ent methods to construct identical families of orthonormal wavelet bases with 
exponentially decaying rf ； € C k (k arbitrary but finite). (Battle was Inspired 
by techniques in quantum field theory; Lemari^ reused some of Tchamitchian 
computations.) Despite having similar properties, the Battle-i^mari4 wavelets 
are different from the Stromberg wavelets. In the fall of 1986, S. Mallat and 
Y. M^rer developed the ^multiresolution analysis” framework, which gave a sat¬ 
isfactory explanation for all these constructions, and provided a tool for the 
construction of yet other bases. But this is for later chapters. Before we get into 
multiresolution analysis, lei us review the construction of Meyer’s wavelet basis. 

The construction of |^| is similar to the tight frame in §3.3.5.A. That frame 
-had redundancy 2 (twice **too many” vectors). Tb 名 et rid of this redundancy, 
Meyer’s construction combines positive and negative frequencies (reducing a pair 
of fuxtctions to a single function). In order to achieve orthonormality, some dev 從 



with the additional property - 

i/(x) + v(l - x) = 1 . (4.2.5) 

The regularity of ^ is the same as that of u. Figure 4.2 shows the shape of a 

typic«U v and |i|_ In order to prove that the 少 m , n (ar) = 2 _m ^ 2 0(2~ m x - n) 
constitute an orthonormal basis, we only have to chedt that ||^|| ~ 1 and that 
the make up a tight frame with frame constant 1 (see Proposition 3.2.1). 



TIM&FREQUENCY DENSITY AND ORTHONORMAL BASES 
tricks with phase factors are needed. More explicitly, we define 分 by 
’ sin[f - 1 )] ， ^ < i^| < ^ , 

^) = J ^r xf2 COS [fi/ ( 忐 ㈦ 一 1 )] ， ^ < ICI < ^ , 

0 otherwise. 


where i/ is a C fe or C°° function satisfying (3.3.25), i.e., 
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= W_1 { 2 f i dssin 2 (i Hs) ] + 2 f / 心 cos HH} 

= |卜/厶咖 2 [|小)]}‘ 

But 


ds cos 2 [| i/(s)j = ds cos 2 [| i/(s)j 


,1/2 

+ / ds eo^ 2 
Jo 



(because i^(s + 1/2) = 1 一 t/(i/2 - s) by (4.2.5)) 


~ J ds cos 2 ^(a)J + J ds' sin 2 ^ 

1 

2 ； 

hence ||^|| 2 — 1. - 

To evaluate n |</ ， V^,n>| 2 , we use Tchamitchian’s frame bound estimates 
(3.3.21), (3.3.22). We first prove that M2%{2k + 1)) = 0 for all fe 6 Z, i.e., for 
all C 6 R, 


J2 ^(2^0 彡 [〆(（+ 2ir(2fc 十 I))] = 0 . (4.2.6) 

/ ==0 


Because of the support of \j> y nonzero contributions to (4.2.6) are only possible 
if |2^C| <^and |2'(C + 27r(2A: +1))( < ^, implying 2^2* +1| < 8/3. The only 
pairs (€,fc) that do not violate this are (0,0), (0, 一 1) ， (1,0), and (1, -1). Let u» 
check Jb = 0 (fc — -1 is analogous). Then the left-hand side of (4.2.6) becomes 


+ 2tt) + ^{20 ^(2C + 4^). 


(4.2.7) 
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One easily checks that both terms in (4.2.7) vanjs|i unless < C < For 
C witkin this interval, C — + with &< a < 1, we have 


(4.2.7) — e - 心 2 sin t/(l - a)] e*(《 +2ir )/ 3 sift [ 盖咖 )j 
+ e - * c cos i/(l - at)j e*“ +2)r > ot« [吾 i^(o)J 

=-cos[| 1 /( 0 ；)] sin [吾 + sin { 吾 i/(a)] cos v(a)] 

* (use (4.2.5)) 

, =P . 


This establishes (4.2.6). On the other hand, one easily checks that 
Sm i^(2 m OI 2 — (27r)~ l for all ^ ^ 0. It then follows from (3.3.21), (3.3.22) that 
the tp m ,n constitute a tight fraihe with frame bound L (Similar computations 
can be used to prove that F(b) (see the end o£ §4.1) constitutes a Riesz basis for 
L 2 (K) i£ b is close to l. 5 ) • 


- This proof that the Meyer wavelets constitute an orthonormal basis reli^ on 
兑 uasi-miraculous cancellations，using the interplay between the phase of ^ auid 
the 印 eci 出 property (4.2.5) of v. Uaang multiresolution analysis, we will be able 
to explain away most of the miracle (see next chapter). Figure 4.3 shows a graph 
of 狀 x )、with Ihe C*~ € dioice t/(x) = i 4 (35 - 84a ： + 20a: 3 } for 0 < a: < 1. 


N6te that bvc» if */ € C°°, so that 畛 decays faster than any inverse polynomial, 
i.e., fcur all iVT 6 N, there exists CV < oo so that 


」 #r)|SCW(l + W 2 )^， (4.2.8) 


the numerical decay of ^ may be rather slow (i.e” inf {o; < -001 Jj^lU® for 

jar) > o} may be very large’ reBecting & large Cn i» (4.2.8)). The exponentially 
decaying wavelets of Stromberg or Battle-Lemari4 hafv^ much faster numerical 
decay, at the price of sacrificing regularity. ^ 



FlO. 4.3. The Meyer womlet if>(x) for the choice */(x) =s x 4 (35 - 84x 十 70x 2 - 20z 3 ). 
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In the matter of orthononnal bases then, wavelets seem to do quite a bit 
better than windowed Fourier functions: there are constructions in whidi both 
if and have fast decay, in stark contrast with Theorem 4.1.1, which forbids 
simultaneous good decay for g and ^ if p is a window function leading to an 
orthonormal basis. If I had written this chapter three years ago, this is probably 
where I would have stored. But matters are not quite that simple: in the last 
few years, the windowed Fourier transform has led to & few surprises, which we 
will discuss briefly in the remainder of this chapter. 


4.2.2. The windowed Fourier transform revisited: *Good” orthonor¬ 
mal bases after all! One way in which one could try to generalize the win¬ 
dowed Fourier coi^truction, so as to get round Theorem is to consider 
families g m>n (x) that are not generated by a strict time-frequency lattice. This 
allows for a little leeway: Bourgain (1988) has constructed an orthonormal basis 
(gj)jcj for L 2 (R) such that 


Jdx {x~Xjf \ 9 j{x)\ 2 < C , 


(4.2.9) 


uniformly in j € J, where 々 —/ dr ®|5j(x)| 2 , = /rfC 4l5i(C){ 2 - (Note 

that wavelet bases do not satisfy such a uniform bound- ) Giving up the lat* 
tic% structure therefore permits better localization than allowed by the Balian- 
Low theorem. However, Steger (private communication, 1986) proved that even 
slightly better localization than (4.2.9) is impossible: L 2 (R) does not admit an 
orthonormal basis (g /) 托 j satisfying 


J dx (x-^) 2(1+<) \gj{x)\ 2 <C , 

* - (4.2.10) 

uniformly in j, if e > 0. This approach can therefore not lead to good time- 
frequency localization. There is another way in which we can try to break away 
from the lattice scheme (4.1.1). Note that in (4.2.9), (4.2.10), lime-frequency 
localization” stands for strong decay properties of the 5 m , n , (g m ,n) A away from 
the average values x mtni 4m,n* This corresponds to a picture in which both 
g m ,n and (^ m , n ) A have essentially one peak. Wilson (1987) proposes instead to 
construct orthonormal bases </ m ,„ of the type 

= /m ( 怎 -n), m € N, n € Z , (4.2.11) 

where / m has two peaks, situated near y and -y, 

fm{i) = (c - y) + <^m (^+^) » (4.2.12) 
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with 扣 ， centered around 0. This ansat2 Ranges the picture completely. 
Wilson (1987) proposes numerical evidence for the existence of such an orthonor¬ 
mal basis, with uniform exponential decay Uk / 和 aod 扣 ， In his numerical 
construction he further “optimizes” the localisation by requiring 


，卜 u);o 


if, 
or if 


\vel- m!\ > 1 
fjm - m ; ( - X , 


(4.2.13) 


Sullivan et al- (1987) present arguments explaining both the existence of Wil¬ 
son^ basis and its exponential decay In both papers there Me infinitely many 
functions • 杷 ； as m tends to oo, the 綠 tend to a limit functum 0^,. 

The moral of Wilson’s construction is that orthonorm^ bases .with good phase 
space localization seem possible after all if b^modal hmetioas as in (4.2.13) are 
used. 

Note that many of our wavelet constructions, frames as well as the orthonor¬ 
mal bases we saw earlier, have these two peaks in frequency (one for $ > 0, one 
for ^ < 0). In the case of frames, or for the continuous wavelet transform, the 
two frequency regions can be separated (corresponding to one-frequency-peak 
functions; see §3.3.5.A or (2 4.9)), but this does not seem to be the case for 
orthonormal bases. We will see later that the two frequency peaks of 垆 need not 
be symmetric: there even esdst examples with ||^| -2 /^ <0 ^ j^(0l 2 arbitrMily 
small (but strictly positive!). However、there is ik> example, so far, of reason¬ 
ably well-localized functions 功土 with support ( 畛士） C ： R 土 and sudi that the 
{fpm,nr 饥 ， 》€ Z, c = + or -} constitute an mthoUormal basis for L 2 (R), cor¬ 
responding to wavelet bases with only one “peiJt” in frequency. (EquivaJently, 
there is no example of a reasonably smooth fuaction rf 二 t/> + such that tlw 
hmetions 2 m/，2 exp (2m 2 m n^) tj(2 m 4), m,n € 2E, are an orthonormai basis of 
jL 2 (R + ).) It is believed, without proof so for，that i^o such basis exists. 7 

But let us return to Wilson bases. If one^ves up the restriction (4.2.13) (if 
fm, <Pm have exponential decay, then these (^lantitieB decay exponentially fast 
in \m — m'|, |n — n'| anyway), then Wilwn's a&saU (4.2,11) ， (4,^. 12) can be 
dramatically simplified. 

In Daubechies, Jaffard, and Journe (19^1), a construction is proposed that 
uses only one function ^ Explicitly, this coJistructioa defines 1 

~ /m ( 工 - 打)》 ^ N \ {0}, ft € Z ， （ 4.2.14) 

with 

Mo : 偏， 

MO - ^ 1^(4 - 2ir) - 0(^ + 2tr)], 

/3(^)-4(^ D + 攸 + 2tr)]c^ 2 , 
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f 4 (0~ WC - 4tt) + + 4tt)], 

MO - ^ - 4»r) ^ 0(^ + 47r)]e^ /2 , 


ht^AO 


\4>(i- ㈣) + ( —1 广攸 + 2tt()) e^ J2 , (4.2 15) 


with £ € N, cr = 0 or 1, and £ = 0, <r — 0 excluded. The result of all these phase 
factors and alternating signs is that 


fi(x) = <A(ar), 
fze+A^) = 1 


«) Ct 


|e 2 ^ + (-i)^ e -2^j^ 


H we relabel the 細, n in (4.2.14) hy defining G m n , m € N, n € Z as 


Gt,tn+<r ~ 92(+<r,n 


atid for f > 0, 


Ot,n{x) -y/2^ (t 


<?o,n(x) = 0(x - n) 


cos 2lr (z if £ + n is cveii 
i^n 2 tt tx if /+n m odd . 


(4.2 16) 


(4.2.17) 


This construction (as well as others mentioned below) shows therefore that the 
key to obtaining good time-frequenty localization {<f> can be chosen so that <f>, 4> 
have exponential decay) ami orthosormaJity in the windowed Fourier framework 
is to use sines and chines (alternated in an appropriate way) rather than complex 
exponentials. 

But let us get bade to (4:2,14)，(4.2,15) and show how this construction can 
lead to an cfrfchonormaf basis. As us^iaJ, we only need to check |f 兑 m , n |j = 1 and 
Hm=i EneZ 知, 《}卩 = 卟 II 2 - We immediately havel|p 1)n || = j|/，U = ||(^||, 

and for m > 1, 

ll^m.nlt 2 = ll/m P = |1/^+ 办 | 2 (Wl = 2(+ £T，^ > 0) 

=\ . _ 2 + 2(-1)^ I di 攸)攸 + 4W) 

(we aseume <f> is real, for simplicity). Hence ||<?m,nIf = 1 for all m, n if 


炎攸 ）4>(A + M) = St。. 


(4.2.18) 


On the other hand. 


E E 队 9 m , n )? j 敗 HO / m (《 + 2 斗 

w*=i neZ rn=l keZ 
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This equals j|A|J 2 if 


/rn(0 L (” 刼 fc) = (2 tt)- 1 4o - (4.2.19) 

m=l 

A few simple manipulations lead to 

f ； I^)Ui + 2nk) 

m=l 

=m + 2nk) + 1^2 <^(C + 如職 + M^2nk) [14 - (-1)*1 
1 t^o 

(4.2.20) 

+\ ( 一 W 攸 - 2^m + 2^£ + 2nk)[l - (~l) k \ . 

m 

/ 

If fc is odd, A: = 2fc’ + 1 ， t 紅 en this reduces to 

X) (-!)' ^~2n£)4>U + M^^ +1)), . (4.2.21) 

eet 

which is zero, since the substitution — -(t + 2k f + 1) transforms (4.2.21) in 
its negative. If k is even, k = 2k\ then (4-2.19) reduces to 

[+ 2tt£) 多 (《 + 2ir/ + 47rfc’）= - (4.2.22) 

teZ 


The {^ m ， n ; m € N \ {0}, n € Z} tl^refore constitute aa ortbonormal basis if 4> 
is a real function satisfying (4.2.18) and (4.2,22). N 械 e that integrating (4.5L22) 
over (，between 0 and 2 tt, automatically leads to (4.2.18), so that we really 
have only the single condition (4.2.22) to s^isfy. This twns out to be easy: we 
can take for instance support <f> c \-2v t 2tt], so that (4.2,22) is automatical 
satisfied for k r ^ 0 T and we only need todieck £ 拓 2 0(C + 2^) 2 - (2tc)~K This 
is true if, e.g” 


術 = 


(2ir) _l/a sin [f * / (^： + l)]» ， -27r <^<0, 
(2^)-^ 2 cos [!" ( 去 ) 0<^<2tt, 


I 0 otherwise，• 

with p as in (42.4). If v is C°°, then the f m have decay faster than any inverse 
polynomial, but, as for the Meyer basis, the numerical decay may be slow. Faster 
decay for Urn f m can be obtained with mmcoiiipiactly supported 4- To construct 
such a ^ satisfying (4.2.22), we can again use the Zak tr£msform r now normalized 
so that 

(Z/i)(M) = (47r)^Vc a ^ M4+ - fl). 
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With this normalization, Z is again unitary from L 2 (R) to Xr 2 ([0, l] 2 ). It is not 
hard to check that (4.2.22) is equivalent to 

'|C^)( 5 ,0I 2 + m)(s + Ml 2 = 2 • (4.2.23) 

(Full details are given in Daubechies, Jaffard, and Joume (1991).) This suggests 
the following technique for constructing <f>: 

• Take any h such that * 

0<a< |2h(M)| 2 + \Zh{a + !，t) 卩 <^<ooi (4.2.24) 

• Define 必 by 

t)^V2 - --^ . (4.2.25) 

[\Zh(s,tr + \Zh(s+lt)\ 2 ] 

If h and h both have exponential decay, then 0 turns out to have exponential 
decay as well. Figure 4.4 shows the graph of <f> and 4> when /i is a Gaussian. 
(Gaussians do indeed satisfy (4.2,24).) An interesting obsen^ition is that (4.2.23) 
is exactly equivalent to the requirement that the ^> mtn {x) — e 2irim * 
or equivalently, the - - m) t with m,n €Z, constitute n tight 

frame (with n6ce®arily redundancy 2) for L 2 (R). The construction (4.2.25) can 
then be interpreted as the transition from a general frame, generated by h t to 
a tight frame, by application of (F*F)~ l/2 (see note 11 after Chapter 3, or 
Daubechies, Jaffaxd, and Journ^ {1991)). This Wilson basis can therefore be 
viewed as the result ef a clever ^weeding*，process on a (tight) frame with ‘*twice 
too many” elements. 

Many variations o» this Wilson scheme are possible. Laeng (19W) has con¬ 
structed an extension of the above scheme in which the frequency spacing need 
not be as regular as here. Auscher (1990) has reformulated the whole construe- 
tion: starting directly from (4.2.16), (4.2.17) as an ai^atz, he derives all the 
results without use of the Fourier transform, and constructs different examples. 
In particular, he obtains example where, in the notations of (4.2.17), the lt win- 
dow w 4> is compactly supported, which is very useful in applications. (The decay 
in frequency is less crucial, as long as it is **reasonable, w ) These examples can 
also be viewed as the result of & a weedmg n procedure on the tight frames with 
redundancy 2 obtained by taking = ?r in §3.4.4.A. 

Other windovved Fourier bases using cosines and sines rather than complex 
exponentials, and leading to good time-frequency localization, have been found 
by Malvar (1990) and Coilmait and Meyer (1990). Malvar’s paper again uses 
altanating sines and cosines; he presents applications of his constructicm to 
speech coding. Coi&nan and Meyer's “localized sine basis” starts from a partition 
of R in intervals, 

R = U … +i ! ， 



where we assume that the ek satisfy aj 4-Cj > a^+i - 勺 +i for all j. Moreover, we 
require that Wj and Wj-i complement each other near aj ： Wj(x) — wj-i(2aj ~x) 
And tUj(x) + Wj„i(x) = 1 if \x — aj\ < Cj. (All this can be achieved with smooth 
one can take, for instance, Wj(x) = sinff ^(—^)1 for \x - aj\ < Cj, and 
^(x) = cos[f for \x - a j+1 \ < f i+1( with 1 / satisfying (4.2.4) 

and (4.2.5).) Coifman and Meyer (1990) prove that the family j,fc G Z}, 
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constitutes an orthonormaJ basis for L 2 (R) t consisting of compactly supported 
functions with fast decay in frequency. This basis has moreover a very interesting 
property： if for any j € Z we define Pj to be the orthogonal projection onto 
the space spanned by the k € Z} (Pj is ‘^morally，the projection into 

[aj, %+ij)，then Pj + Pj + i is exactly the projection operator Pj 、associated 
to [oj , o^+a], that we would have obtained if we had deleted the point o J+ i 
from our “slicing” of ft (i,e. if we had started with the sequence d^, djt = 
if A: < a* = a* + i if fc > j + 1). This property makes it possible to split and 
regroup intervals at will, adapted to the application one has in mind. A very 
nice discussion of this whole construction, with full details, is Auscher, Weiss, 
and Wickerhauser (1992). ， 

So there ig, tt&cr all, more to orthonormal windowed Fburier bases than 
was expected even only a few years ago. None of these bases, however, are 
unconditional bases for I^fR) if p ^ 2. This is one point where wavelet bases 
have the advantage: they turn out to be unconditional bases for a much larger 
family of function spates than even these “good” windowed Fourier bases. We 
will come back to this in Chapter 9. 


Notes. 

1. Rieflfel’s proof does not produce an explicit / orthogonal to all the Sm, n - 
This is a challenge to the reader: find a (simple) construction of jT 丄 p m ， n 
for all m，n，for arbitrary o»o,（o with > 2^r. 

2. For orthonormal bases the proof is much simpler. In this case we need not 
bother with the Zak transform, which was only introduced to prove that 
if Qg f Pg e L 2 , then Qg, PgeL 2 bs well. For orthonormal bases we can 
start directly with point 5, establishing {Qg' Pg) = {Pg, Qg )、which is 
impossible by point 6. This is the original elegant proof in Battle (1988). 

3. If the V>m,n(*) = oo~ m/2 矽 (oo~ m x - nbo) constitute a (tight) 

then so do the = oo _m ’ 2 ^{ao~ m x - nbo*), with — 

(6o/V) 1/2 

4. Tb illustrate this, the following example shows that the complex exponen¬ 
tials e)tp {2-ninx) do not constitute an unconditional basis for £^([0,1)) if 

One can show (see Zygmund (1959)) that 

00 

n -l/4 ! ， 2ir*n® 

[ n ~l/4 e iy/n c 2*»n* 
nsc3 


In both cases, x 0 is the worst singularity, and the mte^rability of 
powers of these functions on [0,1] ia detenmned by their behavior around 


t«H0 W 3/ ‘ 
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0. The first function is in for p < 5 , the second is not, even though 
the absolute values of their Fourier coefficients are the same. This means 
that the fiinctions exp ( 2 ;rina:) do not constitute an unconditional basis 
for L 4 /3([0, 1 }), 

The Haar basis adapted to the interval [0,1] ccrtisistsof m,n e 

Z, m < 0, 0 < n < 2 ,m, - 1}, with 4>{x) = 1 on [0,1]. Hife basis is 
orthonormal in £r 2 ([0, 1 |), and is an unconditional basis for £^([ 0 , 1 J) if 
1 < p < 00 . 

The following is a sketch of the proof that F( 6 ) = n ; m,n 6 Z}, with 
i^n n as in (4 18)，constitutes a Riesz basis (i.e., a linearly independent 
frame) for Z- 2 (R) if 6 is close to 1 . First of ^1, we can still apply (3.3.21), 
(3.3.22) to find estimates for the frame bounds. For 5/1， /3i(2jr(2k + 
1 )/ 6 ) ^ 0 , but if b < 2, then only fc = 0 、± 1 ， ±2 le^l to nonzero 爲 1 . In 
the computation of (4 2.6) (with {2k -f l) replaced by (2k + 1)/6), only a 
finite number of / contribute, so that this expression is continuous in b. 
It follows that the “rest terms” in (3 3.21), (3.3.22) are continuous in & as 
well; since (3.3.21)=(3.3 22)= 1 if 6 = 1， we have ^4 > 0, B < 00 for 6 in 
a neighborhood of 1 . It remains to prove that the ^ n are independent. 
^To do this, we constfiiri the operator 5(6), 


Y (f, Ok 


Clearly, 5(6)^ n = V J m,n* To prove independence of the ^ n it is suf- 
6 cient to prove that j|5(6)/|j > (7||/|(, uniformly in / € i/ 2 (R), for some 
C > 0. But ' 


l|5(&)/|| : 


iff 


Using that for we have 


E a 7 ^ D jk < \ajf )B jk \ 


< Hall sup 53 l^fcl 

J A 


we obtain 


\\S(b)f\\ 2 > ll/H 2 1 - sup J2 M b m,n^)\ 


(4.2.26) 


n/f i-sup ⑽ 
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Because of the support properties of 雀 ， only m' 0， ±1 contribute in this 
sum. If m / = 0 or 1, then any choice of n gives the same result; if m' = 1, 
then the sum may have one of two possible outcomes, depending on whether 
n is odd or even. On the other hand, using the decay |t^(x)} < C/v(l + 
Ixp)-^ of \l> y one easily checks that converges and 

is continuous in b for m , = 0, ±1. It follows that the coefficient of j[/J| 2 in 
the right-hand side of (4.2.26) is continuous in 6; since it is 1 for 6 = 1, it 
is > 0 for d in a neighborhood of 1. 

ft. They satisfy r 

' ， Jdx(x- 2 m n) 2 |V»m,n(x)| 2 < 2 2m C t 

I dC l^ 2 J^m,n(0| 2 < 2^ m C … 

inutead. 

7. After the first printing of this book, a proof was found by P. Auscljer, to be 
published in the Comptes Rendus de rAcademie Scientifique t Paris, under 
the title “II n'existe pas de bases (Tondeiettes regulreres dans I'espace de 
Hardy 丑 2 (R).” Explicitly, he proves that it is impossible that tj € C l and 
1^(01 + }^(^)1 < C(l + |^j)- Q with a > 1/2. 



The first constructions of smooth orthonormal wavelet bases seemed a bit mirac¬ 
ulous, as illustrated by the proof in §4.2.A that the Meyer wavelets constitute 
an orthonormal basis. This situation changed with the advent of multiresolution 
analysis, formulated in the fall of 1986 by Mallat and Meyer. Multiresolution 
analysis provides a natural framework for the understanding of wavelet bases, 
for the construction of new examples. The history of the formulation of 
mixt^rcsolution analysis is a beautiful example of applications stimulating theo¬ 
retical development. When he first learned about the Meyer* basis’ Mallat was 
working an image analysis, where the idea of studying images simultaneously at 
different scales and comparing the results had been popular for many years (see, 
e.g., Witkin (1983) or Burt and Adelson (1983)) This stimulated him to view 
orthonormal wavelet bases as a tool to describe mathematically the “increment 
in information” needed to go from a coarse ^proxiraation to a higher resolution 
approximation. Th^s insight crystallized into multiresolution analysis (Mallat 
(1989), Meyer (1986)). * 


5.1. The basic Idea. 


A multir^olution analysis consists of a sequence of successive approximation 
spaces Vj. More precisely, the closed subspaces Vj satisfy 1 

• ■ • K 2 C Vi C K) C V-i C K_ 2 C • • ■ 

(5.1.1) 

with 



LK = 

jeZ 

- _， 

• (5.1.2) 

n ^ = 

jeZ 

={o}. 

(5.1.3) 


If we denote by P 3 the orthogonal projection operator onto V 3 , then (5.1.2) 
ensures that Umj-^-oo P 3 f — / for all / € L 2 (R). There exist many ladders of 
spaces satisfying (5.1.1)-(5.1.3) that have nothing to do with “multiresohition” ； 
the multiresolution aspect is a consequence of the additional requirement 

f€V 3 ^ /(2^.) € V 0 . (5.1.4) 
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That is, all the spaces are scaled versions of the central space V 0 , An example 
of spaces V 3 satisfying {5.1.1)*(5.L4) is 

% = {/ € L 2 (R); VfeeZ: f\ [2 j k , 2 i{k+i)\ - constant}. 

i 

We wi\\ ccJl thi» example the Haar murtirasolutian analysis. (It is associated with 
the Haar basis; see Chapter 1 or below.) Figure 5.1 shows what the projection of 
some / on the Haar spaces Vq, Vlt might look like. This example also exhibits 
another feature that we require from a multiresolution analysis: invariance of Vi 
Jnder integer translations, 

/eV 0 ^ /(， 一 n)eV 0 for all n € Z . (5.1.5) 

Because of (5.1.4) this implies that if / € then /( - - 2 3 n) G V } for all n € Z- 
Finally, we require also that th<*re exists </>€ V 0 so that 

{0o,n; n € Z} is an Srthonormal basis in Vo , (5.1.6) 

where, for all j, n € Z, 0 Jin (x) = 2’" 2 炎 (2~ J ar - n}. Together, (5.1.6) and (5.1.4) 
imply that {<p 3>n ; n 6 Z} is &n orthonormeJ basis for V 3 for all j € Z. This last 
requirement (5.1.6) seems a bit more “cpatrived” than the other ones; wp will see 
below that it can be relaxed considerably. In the example given above t & possible 
choice for 0 is the indicator functiOB for [0, l] t <(>{x) 1 if 0 < x < 1, 4>(x) ~ 0 

otherwise. We will often call 0 the “scaling function” of the multiresolution 
analysis 2 

The basir tenet of multiresolution analysis is that whenever a collation 
of closed satires {5.1.1)-(5.1.6)，then there exists an orthonormal 

wavelet basis j,k € Z) of L 2 (R), tl> 3 ,k{x) — — fc), such that, 

for all / in L 2 (R) r 

P：~if = ^/ + E ^ ^ ^ ■ (5-1.7) 

keZ 

(Pj is the orthc^onal projection onto V r ) The wavelet ^ can, moreover, be 
constructed explicitly. Let us see how. 

For every j € Z, define W 3 to be the orthc^onal complement of Vj in Vj-\. 
We have 

(5,1,8) 

and ( 

Wj 丄坏 > if j /j'. (5.1.9) 

(If j > e.g., then W 3 C V〆 丄 Wj».) It follows that ， for j < J t 

Vj^Vje © Wj- kl ( 5 . 1 . 10 ) 
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FlG 5 1 A function f and its projwttons onto V_ j and Vq 


where ail these subspacea aro orthogonal By virtue of (5 1.2) and (5.1 3), this 
implies 

Z, 2 (R)«0 Wj t (51,11) 

A decomposition of L 2 (R) into mutually orthogonal subspaces. Furthermore, the 


，崎攀 A decomposition oi L*{ai} into mutuauy orinogonai suospac 
緣 spaced inherit the scaling property (5,1.4) from the V ；： 

3it ' /(2 J .) € W 0 . 



(5.U2) 


Jbrmula (5.1.7) is equivalent to saying that, for fixed j, {%,*; € Z} constitutes 

oq orthonormal basis for W } . Because of (5.1.Jl) and (5.1 2), (5.1.3), this then 
tomatically implies that the whole collection { 也 , j, fc G Z} is an orthononnal 
[b^ 9 ia for Z 2 (R). On the other hand, (5.1.12) ensures that if { 办 ) A: € Z} is an 
^ofthonormal basis for Wo> then k € h} will likewise be an ortfaonormal 

for Wj，for any j € Z. Our task thus reduces to finding ^ e Wb such that 
科 —Jb) constitute an orthononnal basis for Wq. 

lb construct this V»，let us write out some interesting properties of <f> and Wq. 

;an orthonormal baais in K_i, we 


Since 0 C V-\, and the ^i lTi 
have 


(5.U3) 
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hn - {<f>, 0-1,n) and 5Z l^nl 2 = 1 

nCZ 

(5.1.14) 

We can rewrite (5.1.13) as either 


(j>{x) — y/2 ^ h n 4>{2x - n) 

n 

(5.1.15) 

or 

祕)=忐 E h “— tnU2 km ' 

(5.1.16) 

where convergence in either sum holds in L 2 -sense. Formula (5.1.16) can 
be rewritten as 

^(0 = mo(^/2) ^2) , (5.1.17) 

where 


mo(0 = ^ E ^ e — 叫 . 

(5.1.18) 

Equality in (5.1.17) holds pointwise almost everywhere. 
mo is a 27r-periodic function in L 2 ([0, 2n]). 

As (5.1.14) shows, 


2. The orthonormality of the ^>(* — k) leads to special properties for mo. We 
have 


- J dx <l>(x) 4>{x -k) = J d( |0(0 1 2 e ' hi 

= f 2 \ e ^ 1 £\^ + 2 ^)\ 2 ^ 

Jo i^Z 

implying 

^2 + 2tt£)| 2 = (2tt 广 1 a.e. (5.1.19) 

i 

Substituting (5.1.17) leads to (C = ^/2) 

E K(C + ^)l 2 1 祕十抑 ^ 伽 )- 1 ; 

l 

- splitting the sum into even and odd t, using the periodicity of mo and 
applying (5.1.19) once more gives 

|mo(C)| 2 + |mo(C + tt) 卩 =1 a ， e. (5.1.20) 

3. Let us now characterize Wo ： / € Wo is equivalent to / € VLj and / 丄 VJj. 
Since / € VLi, we have 


/ = fn 0-1,n ， 
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f(0 = ^J2fn e~ tn€/2 km = m s {i/2) (5.1.21) 


where 




(5.1.22) 


m/ is a 27r-periodic function in 1» 2 ([0,2 兀】)； convergence in (5.1.22) holds * 
pointwise a.e. The constraint / 丄 implies / 丄 少 0 ，友 for all fc, i.e.， 


I f(0 W) 


0 




hence 


E /(C + 2^)0(€ + 2^) = 0 


(5 1.23) 


where the series in (5 1.23) converges ateolutely in L 1 ^—7r,7r]). Substitut¬ 
ing (5.1.17) and (5 1 21), regrouping the sums for odd and even £ (which we 
are allowed to do, because of the absolute convergence), and using (5.1.19) 
Is to 


lead: 


»^/(C) ^(C) + m/(C + 7r) mo(C + ^) — 0 a.e. (5.1.24) 

- « 

Since m 0 (C) and m 0 (C + cannot vanish together on a set of nonzero 
measure (because of (5 1.20))，this implies the existence of a 27r-periodic 
function X(Q so that 



m/(C) ^ A(C) mo(C + 7r) a.e. - 

(5.1.25) 

and 

A(C) + MC + 霄 ）= 0 a.e. 

(5.1.26) 

This last equation can be recast as 



A(c) 二 〆 1/(20 ， k 

(5.1.27) 

where 

v is 27r-periodic. Substituting (5.1.27) and (5.1.25) into 

(kl.21) 

gives 

m = mom + 7t) 你 /2 ) ， 

(5.1.28) 


where u is 27r-periodic. 
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4 ‘ TJie general form (5.1.28) for the Fourier transform of / e Wq suggests 
that we take ’ 

^(0= e*«/ 2 mo^/2 + 7r) 4>{if2) (5.1.29) 

as a candidate for our wavelet. Disregarding convergence questions, 
(5.1.28) can indeed be written as 


or 






m 


jb 


so that the tp(——ri) are a good candidate for a basis of Wo. We need 
to verify that the ^o.Jt are indeed an orthonormal basis for Wq, First 
of all, the properties of m© and ensure that (5.1.29) defines indeed an 
L 2 -function 6 V_i and 丄 Vb (by the analysis above), so that if e Wq. 
Orthonormality of the 如 is easy to check: 


j dx il>(x) ^>{x — k )= 


J m)\ : 


r2n 


dC ^ V 咖 + 2W)| 5 


Now 

+ 2 叫 I 2 二 E i^/ 2 + W + 贫 )l 2 f 你 /2 + 
e t 

- K«/2 + ir)[ 2 53 ^/2 + 27ru)i 2 

n 

+ |m 0 (《/2) 卩 f I 岑 (C/2 + 7T + 27rn)i 2 

n 

- (2ir) _1 [|mo(《/2) 卩 + jm 0 (《/2 + 7T)| 2 ] a.e. (by (5.1.19)) 
=(2 tt) _ 1 a.e. (by'(5.1.20)) • 


Hence J dx ^{x) «x — A:) = 6^ In order to check that the 咖,* are 
indeed a basis for all of Wo t it then suffices to check that any f €Wq can 
be written as 

/ 二 53 ^0,n > 

*" n 

with l7n| 2 < oo, or 

n m^iio m, (s.1.30) 
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with 7 2 ir-periodic and e X/ 2 ([0, 2 tt]). Let us go back to (5.1 28). We have 
/⑹ =with / 0 2ff 炎 MOI 2 = 成 |A(C)| 2 . By (5 1 22 ). 

J o d^\m f (0\ 2 \fn\ 2 = m\ 2 <oo 


On the other hand, by (5 1.25), 


处 \m f {0\ 2 


炎 |A(()P|mo(C + 汉 )| 2 

\ IMOI 2 [|mo« + 7r )| 2 + |mo(Oi 4 ] (use (5 1 26)) 
\\m\ 2 (use (5.1.20)) 



/o^ H0\ 2 - Jl/ii 2 
int 艰 able 27r-periodic *y 


< oo, and / is of the form (5 1 30) with 


We have thus proved the following theOTcm- 

THEOREM 5.1 1 If a ladder of closed subspaces tn L 2 (R) satis¬ 

fies ffie afndtttons (5.1.1 )-(5.1.6), then there exists an associated orthonormal 
wavelet basts j,k eZ] for L 2 {R) such that 


% 


m 

i' 


P 3 -I ^ Pj > : (*» ^j,k) (5 1 - 31 ) 

k , 

One posstbtltty for the construction of the wavelet ^ is 

m^^ /2 mo(e/ 2 -f«-)^/ 2 ), 

(mth pio as defined by (5.1,18), (5.1.14)), or equtvedentiy 

^ = [(-I)”- 1 ， (5 1.32) 

、 n 

- V2 [(—l)"- 1 /i-n -1 */>(2x - n). 

n 

{with convergence of the last senes tn L 2 -sense)~ 

Note that 妒 is not determined uniquely% the multiresolution analysis ladder 
and requirement (5.1.31)* if ip satisfies (5.1.31), then so will any ip* of the type 




(5.1.33) 


with p 27r-periodic and |p(^)f = 1 a.e. a In |iaartlciilar y we can choose p(^) = po e tTnp 
with m € Z ， |po| = 1 ， which corre^os^ to a phase change and a shift by m for 
it. We will use this freedom to define，Instead of (5.1.32), 


^ ^ ^2 9n with ffn = (~l) n *-n+l 


(5.1.34) 
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or occasionally 

9n: (-l) n h— i+2N , (5.1.35) 

with appropriately chosen N e Z. Of course we can take more general p in 
(5.1.33), but we will generally stick to (5.1.34) or (5.1.35). 4 

Even though every orthonormal wavelet basis of practical interest, known to 
this date, is associated with a multiresolution analysis, it is possible to cxjnstruct 
“pathological” 垆 such that the = 2 一 " 2 ^(2~ 3 x — Ar) constitute an or- 

thonormai basis for L 2 (R) but are not derivable from a multiresolution analysis. 
The following example (due to J. L- Jourae) is borrowed from Mallat (1989). 
Define " 

^)4 W ' 1/2 爭， （5 丄 36) 

^ 0 otherwise . 

We immediately have |j^j,fe|| — — 1* Furthermore, 2^^ — 1 a.e. 

By Tchamitchian's criterium (3.3.21)~(3.3.22) the therefore also constitute 
a tight frame with frame constant 1, provided 

OO _ _ _ _ _ 

々如 + 2?r(2fc + 1))) = 0 a.e. (5.1.37) 

One easily checks that support ^ n [support ^ 4- (2fc + 1)2 tt 2^] has zero measure 
for all ^ > 0. A: G Z, so that (5.1.37) is indeed* satisfied- It then follows from 
Proposition 3.2.1 that the ipjjf ccmstitute an orthonormal basis for Z/ 2 (E). 

If ip were associated with a multiresolution analysis, then (5-1.29) and (5.1.17) 
would hold for the corresponding scaling {unction ^ (with possibly on extra p(^), 
|/>“)| = 1 a.e. in the formula for tl >~see (5.1.33)). It then follows from (5.1.20) 
that * 

l^)I 2 + l^)| 2 = ^/2)| 2 , (5.1.38) 

which implies, for ^ ^ 0, 

i^)i 2 = E m j o \ 2 . 

One easily checks from (5.1.36) that this implies 

( 么 r )-" 2 if 0 < \i\ < 4TT/7, 
or ir < |^| < 8k/7 , 
or 2ir < 1^} < 16tt/7 , 

0 otherwise. 

If there existed a 27r-periodic mo so that (5.1.17) held for this then we would 
have |m 0 (C)| = 1 for 0 < |^| < 47 r/ 7 . By periodicity this would imply |mo(^)| = 1 
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as well for 27r < ^ < 18 tt/ 7; hence |mo(^)| l^(C)f - (27r) _1 / 2 for 27r < ^ < 167r/7, 
even though |^(2^)| = 0 on this interval. This contradiction proves that 
this orthonormal wavelet basis is not derivable from a multiresolution analysis. 
Note that ip has very bad decay. It is an open problem whether this kind of 
“pathology” c^n persist if some smoothness is imposed upon ^ (i.e., decay on 
妒 ). 5 For later convenience, we note that in terms of the /i„, equation (5.1.20) 
can be rewritten as 

= S k ,o - (51-39) 

n 

(This follows easily from writing out the explicit Fourier series for |m 0 (C ) 卩 + 

|mo(C + tt)| 2 -) 


$.2. Examples. 

Let us see what the recipe (5.1.34) gives Crar the Haar multiresolution analysis. 
In that case, <f>{x) = 1 for 0 < ar < 1, 0 oth^-wise; hence 



dx <f>(x) 4>(2x -n)= 


{ 


1/V2 

0 


if n = 0,1, 
otherwise. 


Consequently, tp - ^ ^-i,o - ^ or 

1 if 0<x< I ， 
i；{x) = < -1 if § <x< 1, 


This is the Haar basis, which is no surprise: we already saw in §1.6 that this 
wavelet basis is associated with the Haar multiresolution analysis, 
f The Meyer basis also fits neatly into this scheme. To see this, define </> by 


ko 


iei< 2 tt/3, 

(27T)- 1 / 2 cos[fi/ (^Kl-l)], 27r/3<|d< 4 贫 /3, 
0 otherwise, 


where */ is a smooth function satisfying (4.2.4) and (4.2.5). 》 is plotted in 
Figure 5.2. It is an easy consequence of (4.2.5) that 5^ fceZ |^+27r/:)| 2 = (2 艽) _1 ， 
i^iich is equivalent to orthonormality of the 机 • 一 k), k e Z (see §5.2). We then 


define to be the closed subspace spanned by this orthonormal set. Similarly, 
\Q is the closed space spanned by the 伞咖 k€Z. The V 3 satisfy (5.1.1) if and 
^joply if 必 € V_i, i.e.，if and only if there exists a 2ir-periodic function mo, square 
Megrable on [0, 27r], so that 


MO = moK/2) 你 /2) - 
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Fig. 5,2 The seating funetton ^ far the Meyer basis, unth i/(x) = x 4 (35 — 84x 十 70x 2 — 

20i 3 ). 


In this particular case, toq can be easily constructed from $ itself: 
mo(^) = \/2w J2eeZ 摹 ( 2 (《+ 2wf)). This is 2ir-periodic and in L 2 ([0, 2?rJ), 
and * 

moimkm = v^E^ +4 ^>^/ 2 ) 

* = \/27T 4>{i) 0(^/2) 

(because Support 摹 (*/2)] and [support j>(- + 4ir^)] 
do not overlap if £ / 0) 

; 屯(0 、 

(because 岑 ( 《 /2) = 1 for ^ e supped i). 


I leave it as an (easy) exercise for the reader to check that the V 3 also satisfy 
properties (5.1.2), (5.1.3) {(5.1.4) and (5.1.5) are trivially satisfied already; see 
also §5.3.2). Let us now apply tJie recipe (5.1.29) to find tj)： 

^ 奴⑼ + 1 )) km 

tGZ 

= + 2jt) + - 2ff)] 雀 ( 《 /2) 

(f<»- all other l t the supports of the two factors do not overl^ . 


It is easy to dieck (see also Figure 5.3) that thia is equivalent to (4.2.3). The 
phase factor e*^ 2 which was needed £or the ^liraculous caiM^flationa” in §4.2 


occurs here naturally as a consequence of the general analysis in §5.1. 
B^ore we discuas other examples, we need to relax condition (5.1.6). 
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Relaxing some of the conditions. 

Riesz bases of scaling functions. The orthonormality of the 沴 ( *— k) 
(5.1.6) can be relaxed: we only need to require that the 0( - - k) constitute 
*4 Riesz basis. The following argument shows how to construct an orthonormal 
bisis - A:) for Vo starting from a Riesz basis {</>( - k); k e Z} of V 0 . 
Tie - fc) are a Riesz basis for Vo if and only if they span and if, for all 

i^z € e 2 (zh 


4 E i c *i 2 ^ 5Z Cfe ^ - k A ^ 


where > > 0, B < oo are independent of the (see Preiiminaries). 
But 


E* Ck4>(--k)\\ - fd^\^ k c k 4>(0\ 


炎螂 Ei^+ 2 ^)i 3 
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and 


E-hfe! 2 = (^Tr)- 1 f c fc e 




so that (5.3,1) is equivalent to 

0 < (2^y x A < |^ + 2n£)\ 2 < (2^)-^ < oo a.e. 


(5.?*2) 


We can therefore define 0# € L 2 (R) by 


妒⑹ =(2 开 )， 




- 1/2 


m. 


(5.3.3) 


Clearly, J2e + 2?r^)| 2 = (2 开广 1 a.e., which means that the 0 # ( - fc) are 

orthonormal. On the other hand, the space V 0 # spanned by the - k) is 
given by 

V 0 * - |/； / - E /nV(-n), {/ n # ) n€Z €£ 2 (Z)| 

={/； / = ^ with u 2n- periodic, v e L 2 ({0, 2ttJ)} 

={/； f — ^ with Vi 2 tt- periodic, ui € Z/ 2 {[0,2tt])} 

(use (5.3.2) and (5.3.3)) 

= … with (/„) neZ 6 ^(Z)| 

=V^o (since the <f>{- - n) are a Riesz basis for Vq). 


5.3.2. Using the scaling ftlnction as a starting point. As Hescribed 
in §5.1, a multiresolution analysis ccmsists of a ladder of spaces (V^) jG 2 
a special function € V 0 such that (5.1.1)-(5.1.6) are satisfied (with (5.1.6) 
possibly relaxed as in §5.3.1). One can also try to start the construction from 
an appropriate choice for the scaling function <f>: after all, Vo can be constructed 
from the 0( — k) r and from there, all the other V 3 can be generated. This strategy 
is followed in many examples. More precisely, we choose <f> such that 

<f>(x) - 5] Cn^x-n), (5.3.4) 

n 

where J2 n Icnl 2 < °°， 

0 < a < 52 + 2d)| 2 </?<oo. . (5:3.5) 

2€Z 

’We then define Vj to be the closed subspace spanned by the 知 *, k with 
(f>j,k(x) = 2 ~以 <ft[2~^x - k). The conditions (5.3.4) and (5.3.5) are neces¬ 
sary and sufficient to ensure thcU; A: € Z} is a Riesz basis m each Vj, attd 
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that the V 3 satisfy the “ladder property” (5.1.1). It follows that the Vj satisfy 
(5.1.1) ， (5.1.4), (5.1.5)，and (5.1.6); in order to make sure that we have a mul- 
tiresolution analysis we need to check whether (5.1.2) and (5.1.3) hold. This is 
the purpose of the following two propositions. 

PROPOSITION 5.3.1. Suppose 4> e L 2 (R) satisfies (5.3.5), and define Vj — 
Span k G Z}. Then V } = {0}. 


Proof. 

、 

1. By (5.3.5), the 必 o,* constitute a Riesz basis for Vo- In particular, they 
constitute a frame for Vo, i.e” there exist > 0, B < cxi so that, for all 

/ ^ M)* ' 

A ll/ll 2 < 53 K/* Ml 2 ^ B H/ll 2 (5-3-6) 

fceZ , 

(see Preliminaries). Since Vj and the 4> Jf k are the images of Vq and the 
under the unitary map (Djf)(x) — 2— f{2~ } x) t it follows that r for all 

A ll/H 2 < X ； K/. ^ B ll/ll 2 - ( 5 . 3 . 7 ) 

' kd 

with the same A, J? as in (5.3.6). - 

2. Now take / e V 3 . Pick e > 0 arbitrarily small. There exists a 

compactly supported and continuous / so that ||/ -/IIl* < If we denote 
by P } the orthogonal projection on V ]y then 

\\!-Pj\\ = ||^(/-/)11<11/-/11 <^； 

hence * 

li/ll < ^ + \\Pjf\\ forallj€Z. (5.3.8) 

3. \\Pj\\<A~^[E k€Z |{/, ^, fc )| 2 ] 1/2 ,and 


Dm $ 

k 


< 

< 


2- J Y, / ^ l/»l \4>(2- j x-k)\ 

(R chosen so that [-i?, i2] contains the 
compact support of /) 

2 巧 dxm-^x~k)\ 

k V\-\^ > 




1 齡 


( 5 . 3 . 9 ) 
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with 5 r,j = U*. € z [k - 2~ J R, A + 2~^jR|, where we assume that j is large 
enough so that 2~ 3 R < 

4. We can rewrite (5.3.9) as 

E K/' 〜〉 i 2 $ mhu J % dy X Avmy )\ 2 (53.10) 

where \j is the indicator function of Sr } , i.e” Xjiv) = 1 if y € Sr } , 
Xj (j/) = 0 if y ^ Srj . For j/ ^ Z, we obviously have Xj (y) 0 f° r J °°- 

It therefore follows from the dominated convergence theorem that (5.3.10) 
tends to 0 for j — oo. lit particular, there exists a j sudi that (5.3.9) 
< c 2 A. Putting this together with (5.3.8), we find jj/|J < 2c. Since e was 
arbitrarily small to start with, / — 0. ■ 


This proves that (5.1.3) is satisfied. For (5.1.2) we introduce the additional 
hypotheses that 岑 is bounded and that f dx 4>{x) ^ 0. 

Proposition 5.3.2. Suppose tkat<f>e L 2 (R) satisfies (5.3.5) and that, more¬ 
over, is bounded for all ( and continwms near 《 [ 0, vnth $(0) _ 0. Define 
V 3 as above. Then U j€ z Vj = L 2 (R). 

Proof. 

* 1. We will use again that (5.3.7) holds, with A, B indepen<tent of j. 

* 

X Talee / € (U je z O 丄 • Fix e > 0 arbitrarily small. There exists a compactly 
supported *C°° function / so that ||/ — /JU* £ Consequently, for all 

= \\Pj\\ = 11^(/-/)ll (since Pj/^0) 

< c. (5.3.11) 

On the other hand, by (5.3.7), 

WP.jff > B- 1 Yi K/. ^^)i 2 - (5.3.12) 

fceZ 


3. By standard manipulations (see Chapter 3) we have 

E i</, 4 >~j t k )\ 2 - 2 tt /de m 2 - j o \ 2 i/(oi 2 + r , 


*€Z 


(5.3.13) 


with 

i^i < i^\h)\\h^^ 2 ^)i m~ J o\ 2^)1 

t^o J 


< 


mu E / 屯 1 ^)1^ 



MULTIRESOLUTION ANALYSIS 


143 


Since / is C 00 , 


can find C so that 


(5.3.14) 


It then follows that 


m < C 2 U\\U E / 屯 u + 记十 2 j O_ 3 , 2 (1 + I 卜 2 J ^)-^ 2 
e^o ^ 

< c wi« ^(i+t 2 fdc a+ ici 3 )* 1 * 

l#0 ^ 

(use sup (1 + y 2 )\l + (^~ y ) 2 ] -1 ! 1 + + 3/) 2 ] -1 < oo twice I 

\ x,y£R J 

< C n t~ J . , (5.3.15) 

4. Putting (5.3.12), (5.3.13), (5.3.14), and (5.3.15) together, we find 

Jd^ \4>(2- J 0\ 2 |/(《) 卩 S 执 2 + . (5.3.16) 

Snce is uniformly bounded as well as continuous in ^ = 0, the left- 
hand side of (5.3.16) converges to 27r|^(0)) 2 }|/|j| 3 (by the dominated con- 
* vergence theorem) for J -+ oo. It therefore follows that 


ii/Hl- < i^r 1 ^, 


(5.3.17) 


with C independent_Qf e. ComHning (5.3.17) with ||/ - /||t a < e, 
obtain 


Since e was arbitrarily small, / = 0. 


Remarks. 

1. If slightly stronger conditions are imposed on <p y then Propositions 5.3.1 and 
5.3.2 can be proved with easier estimates. Id Micchelli (1990), for example, 
the same conclusions are derived if ^ is continuous and satisfies J^(x)j < 
C(1 4 - |i|)~ 1_€ , ^2 (e i <f>(x -t)~ const. ^ 0, which implies both <f> e L 1 
and / dx 0(x) ^ 0. 

2* The extra condition that ^ be continuous in 0 in Proposition 5.3.3 is not 
necessary. The following is &n example of a multiresolution analysis in 
which the scaling function is not absolutely mtegrable. Let Vf 4 , 广 ，螃 M 
be, respectively, the multiresolution spaces，the scaling function, and the 
wavelet for the Meyer wavelet basis, with v € C°° (see §5.2). Let H be 
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the Hilbert transform ， (if/) A (0 = f(《) if ^ > 0, ~f(0 if ( < 0. Define 
V 3 = HVj 4 ^ <f> = H4> M ■ Because the Hilbert transform is unitary and 
commutes with scaling and with trai^lations (in x), the V 3 still constitute 
a multiresolution analysis, and the 0o,Jt are an orthonormal basis in Vo- 
But 4> is not continuous m 0. Because 0 ^ support ^ 

is a C°° -function with compact support, so that rp itself is C°° with fast 
decay. This is therefore an example of a very smooth wavelet with good 
decay, associated to a multiresolution analysis with bad decay for tf>. 6 Note 
also that <j> M and 4> satisfy (5.1.17) with the same mo, illustrating that the 
c n in (5.3.4), or equivalently mo, do not determine 4> uniquely, and that 
decay of the Cn as |n|-+oo does not ensure decay for <f>. 7 

3. If is bounded, and continuous in 0, then the condition ^(0) ^ 0 is nec¬ 

essary in Proposition 5.3.3. This can be seen as follows. Take / € L 2 (R) t 
/ / 0, with support / C R < oo. If U j€ i Vj — L 2 (R), then 

/ - limj—oo P-jf. But 

HP-j/li 2 < .4- 1 52 HA 

k 

< A- 1 ^27r \^(2- J 0f \m\ 2 + R , 

as in (5.3.13). Since ^ is continuous, the first term tends to 
A~ l 2tt|^( 0)| 2 jl/jj 2 for J—»cx>, by the dominated convergence theorem. 
The second term can be bounded exactly as in (5.3.15), so that this terra 
tends to zero for J-kxj. It follows that 

ll/fl 2 = \\P-Jff < 2tt yt- 1 \m\ 2 li/ll 2 • 

Since |J/|| ^ 0, this implies ^(0) ^ 0. 

4. The argument in points 3 and 4 of the proof can also be used to prove 
| 摹 (0 )卩 < B/2tt. We have indeed 

B!|/|| 2 >B||P„y/|j 2 >X ； K/^-^)l 2 

fceZ 

^2nj^(2- J 0\ 2 m\ 2 + R, 

where |H| can be bounded by C2~ J for nice /. The other term tends to 
27r|^(0)|?l(/|j 2 (see 4). Tbgether with remark 3 above, this impli 枕 A/2n < 
10(0) I 2 < B/2w. In particular, if the 如， fc are orthonormal, then A = B 
and (0(0)( = (2n)~ 1/2 . 

5. The conditions $ € L°°, 0(0) ^ 0 (with 0 continuous in 0) impfy certain 
restrictions on the c» as well. Equation (5.3.4) can be rewritten as 

^ 祕） = mo(C/2) ^/2) , (5.3,18) 
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with rno(^) = I ]Cn e ,n€ . In particular, ^(0) — mo(0) <^(0), which 
implies mo(0) = 1 (since 0(0) ^ 0) or 

(53.19) 


Moreover, (5.3.18) implies that mo is continuous，except possibly near 
the zeros of 0. In particular, ttiq is continuous in ^ = 0. If, further¬ 
more, |0(4)| < C(1 + |《|) _1 / 2_ % then the continuity af 4> implies that 
53/ \4>i^ + 27t/)| 2 is continuous as well, so that (as defined in §5.3.1) is 
also continuous; consequently, m,Q (^) — satisfies m* (0) = 1. 

Since |m^(0I 2 + 1饥？((+丌) 卩 = 1，社 follows that m*(it) = 0. This implies 

mo ㈨ = 0 (mf (0 = mo(OE>« + 2^)| 2 ] J ^ • [J：. i^ + 2 响 2 卜/ 2 >， 
or 

53 c„(-l) n - 0 . (5.3.20) 


Together with Cn = 2, this implies C 2 n — 1 = c 2 n+i. This is 
consistent with the admissibility condition for 矽 . 8 Note also that C 2 „ = 
1 — C 2 n+i is equivalent with Micchelli (ld^O)^ condition </>(^-^) — 
const. ^ 0 if |0(a:)| < C (1 + |ar|) _1 ~* and if 0 is continuous. 9 □ 


All this suggests the following strategy for construction of new orthonor- 
mal wavelet bases: 

• Choose <j> so that (1) <f> and have reasonably decay, 

(2) (5.3.4) and (5.3.5) are satisfied, 

(3) JdxH^^O 

(by Propositions 5.3.1, 5.3.2 the Vj then constitute a multiresolution anal¬ 
ysis); , 

• If necessary, perform the “orthonormaiization trick” 

r -1/2 . 

^ # (0 - HO 2tt Y, WC + 2^)| 2 ; 

. t 


,• Finally, ^i(^) — {i/2 + ir)^ # (^/2), with ⑹ =mo(0 

E, 1 你 + 2^)| 2 ] 1 / 2 [E/ + 2H)\ 2 ]-^ 2 y or equivalently 

懒 = h -n + i <-n)> 


with (0 = ^ En 
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5.4. More examples: The Battle-Lemari^ family. 

The Battle- Lemari^ wavelets are associated with multiresolution analysis ladders 
consisting of spline function spaces; in each case we take a B-spline with knots 
at the integers as the original scaling function. If we dtioose 4> to be the piecewise 
constant spline, 

0{ } - t 0 otherwise, 

then we end up with the Haar basis. 

The next example is the piecewise linear spline, 


0 (^)= 




o < N < l, 

otherwise, 


plotted in Figure 5,4a. This 沴 satisfies 

<l>(x) = \ 《 (2o: + 1) + <f>{2x) + i <f>(2x - i); 


see Figure 5.4b. Its Fourier transform is 、 


and I 故 + 2 州 | 2 丄 § + ! cos^ |(1-H 2cos 2 ^/2). 10 




Fig. 5.4. The piecevtue Unear B~9pHne it satisfies 碘 (*} = \<t^{2x + 1) + ^(2x) + § 
^(2x _ 1)* 
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Both (5.3.4) and (5 3.5) are satisfied, ^ G L 1 and / dx <f>(x) = 1^0. The 
Vj constitute a multiresolution analysis (consisting of piecewise linear ftmctk»ns 
with knots at 2 J Z). Since 0 is not orthogonal to its translates, we need to apply 
the orthogonalization trick (5.3.3) 


^>*(0 - v ^( 27 r )- 1/2 


4 sin 2 ^/2 

^ [1 +2cos2l/2] 1 /2 . 


Unlike 4> itself, is not compactly supported ； its graph is plotted in Figure 5.5a. 
To plot the easiest procedure is to compute (numerically) the Fourier coef¬ 
ficients of [1 + 2 《 /2 广" 2 ， 


[l + 2cos 2 = X) 〜 厂 叫， 


and to write <j>*{x) ~ 琴 Yin Ct » — 打 )* The corrraponding is 
j "、_ 2 … ri + 2cos 2 4/21 1/2 


cos^ ^/2 


1 +2COS 2 《 
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and ^ is given by 


m 


/ /2 sin 2 《/4 


ri + 2sin 2 i/A 


[l + 2cos 2 i/2\ 


1/2 


妒 m) 


sin 2 €/4 


l + 2sin 2 i/A 


1/2 


执 m • 


(1 ^~2cos 2 《 /2)(l + 2cos 2 之 /4) 

Again we can compute the Fourier coefficients d n of [(1 - sin 2 ^/4) (1 
cos 2 ^/2) _1 (1 +cos 2 ^/4) -1 ] 1/2 , and write 

~T 


0(X) 


(^n+i — 2rf n + d n -\) <f>(2x — n). 


0( 工） 


This function is plotted in Figure 5.5^. 

In the next example ^ is a piecewise quadratic B-spJine, 

i(f+l ) 2 ， -l<x<0, 

I _ (z — 妻) 2 ， 0 < a: < 1 , 

I (i - 2) 2 , 1 < x < 2 , 

0 otherwise , 

as plotted in Figure 5.6a. Now (f> satisfies 

4>{x) - \ 4>(2x + l) + f <f>(2x) + § 4>{2x -1) + | 4>{2x - 2) 
(see Figure 5.6b )； we have 


m 


i^r l/2 e-^ 


^/2 ) 


and 2?r YLt |^ + 2^)| 2 = 

Again (5.3.4) and (5.3.5) 

♦(• 一 fc) are not orthonormal, and 
(5.3.3) to find and ttIq before 
given in Figure 5.7. 

In the general case, 0 is a B-spline of degree N, 


M + i cose + 点 cos2^=r ^ + i§cos^-f icos 2 ^ 

are satisfied, and G L l , with j dx <j>(x) ^ 0. Th 
need to apply the orthogonalization trk 
can construct ip Graphs of ♦替 and ip af 


N + l 


m = (2ny^e~^ ( 臀） , 

where /C = 0 if TV is odd, AC = 1 if iV is even. This 0 satisfies / dx <f>(x) 


am 


4 >(^)= 


r 2~ 2M ^ ^2A/+ ^ if TV = 2M is even 

2 - 2 M-i ^ ^( 2x -M-1+j) if TV = 2Af 4-lis odd. 
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Fig 5 6 The quadraUc B-spltne 令， translated so that tti knots are at the integers It 
satisfies + 1) + ~^(2x) + |^(2x - 1) + \ij>{2x - 2) 

Explicit formulas for h |0(^ + 27r^)j 2 , for general TV, can be found, e.g., in 
Chui (1992). In all cases, ^ satisfies (5.3.4), (5.3.5). For even N t <f> is symmetric 
around a: = |, for odd N, around x — 0. Except for JV = 0 , the <f> {- — k) are 
not orthonormal, and the orthogonalization trick (5.3.3) has to be applied. The 
result is that support (f>* = R = support ip for all the Battle-Lemari 6 wavelets. 
The “orthonormalized” <f>^ has the same symmetry axis as </>. The symmetry 
axis of ip always lies at x = (For N even, ip is antisymmetric around this axis, 
for N odd, ip is symmetric.) Even though the supports of <f>* and xp “stretch 
out” over the whole line, ♦眷 and tp still have very good (exponential) decay. To 
prove this, we need the following proposition. 

PROPOSITION 5.4.1. Assume that </> has exponential decay, \<f>{x)\ < 

C e— 7 | 蛸， and that, for some a < 7 (a > 0), 

sup |(e^ 0) A (OI <C(1 + |^|)- l - e . (5.4.1) 

\0\<o 

Assume also that 0 < a < Y!>t I 多 (C + 27 r£)| 2 . Define <f>* by — 

^(0 [27r ^ + 27r^)| 2 ] _1/2 . Then (f>* has exponential decay as well 
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Fig. 5 7 - The 3 caltng function <(> and the wavelet ^ for the quadntic tphne Battle-Leman^ 
construction. ' 


Proof, 

1. The bound 10(x)j < C e" Q,r| implies that 4>{i) has an analytic extension 
to tho^strip |Im 《I < a, and that' 多 (• + 也 ） € L 2 (R) for all j^si < ot. The 
same is true for 6(() = 

2. For fixed Ca. define = 4>{ii 十必 *) <K _ 《i ~ 浴 )* Then 


E i^(^+ 2 ^)s 

let 


< 


(? 


1^(6 + + 


-r(? 


1/3 


|系(_6 _ % — 2v£)\ 4 


and 

_1+心 + 2 岣| 2 

e 

< ^ J d^i |0(4x + 1^2)| a + 2 y 1^(^1 + 化 + i6)| 
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去 J dxe^\<f>{x)? „ 

dx e 2 ^*|0(it)| 2 j J dx e^ 3X x 2 |<^(x)pj 


1/2 


< 00. 


(We have used that |/(a: + 27r^)| < ( 2 tt )~ 1 f dx j/(x)i + j dx |/ / (x)|. 11 ) 
Consequently，i^ a (G + 2ir£) converges absolutely if |Im ^ 2 ! < 7- 
Similar bounds, combined with the dominated convergence theorem, show 
that Ylt (Ci + 2 tt^) is analytic in ^ ^ -t- 1^ 2 on the strip |Im《| < 7 ‘ 

3. The function <7(0 = Yle + 2 ?r/)J 2 has thus an*analytic extension to 
|Im《| < 7 . Since G is periodic，with period 2 ?r, and (?| 里 > o > 0, this 
implies that there exists a, possibly smaller than 7, sq that ReG(^) > a /2 
for |Im < a. Consequently, G _ " 2 can be defined as an analytic function 
on |Im < a r which means that — G~ ] ^ 2 4> has an extension to a 
uniformly bounded analytic function on the strip |Im < a. 

4. On the other hand, (5.4.1) implies that 

^ fer )^ 2 ! < o* It follows that on jlm < rnin (q, a), is analytic, and is 
boo&ded by 

, | 0 # (OI<C{l-MRe^|r 1 -. 

Consequently, 


|0 # (x)| = lim (2 tt 广 1 ’ 2 

R-*oo 

' —Jim (27r)~ 


r 

r 

-R 


# e lfr _(e)| 

rfCi (6+i6) 

+ / ' d»€^ R e~ >x <p*(~R + is) 
Jo 

rK'i 

- / d3€^ R €- ，X ^{R + i8) 

Jo 

< C e~ i2X t for |^a| < min (a, a) , • 


卜 COROLLARY 5*4.2. AU the Battle-Lemarii wavelets^ and the corresponding 
tsihonarmal scaling functions ♦ 养 have exponential decay. 
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5.6. Regularity of orthonormal wavelet bases. 

For wavelet bases (orthonormal or not—®ee Chapter 8) there is & link between 
the regularity of ^ and the multiplicity o£ the zero at ^ = 0 of Thi6 is & 
consequence of the following theorem ( 敁 ated ftod proved in greater generality 
than needed here, for later convenience). 

Theorem 5.5.1. Suppose f } f are two functions, not identically constant ,' 
tuch that 

</>,* ， /y.AtO = ^jj t 6 kh f i 

mthf 3fk (x) = 2~^ 2 /(2^x-Jfe), / ifJk (x) = 2-^ 2 /(2 ~ j x - k). Suppose that 
\f(x)\ < C(l + \x\r- f with a > m + l, <md suppose that f € C^*, with f ⑷ 
bounded for t<m. Then 

Jdx x ( f(x) = 0 fori = 0,1, (5,5.1) 

Proof. 

1. The idea of the proof is very simple. Choose j, Jt, / ， fc’ so that f 3t k is rather 

spread out, and /〆,** very much concentrated. (For this expository point 
only, we assume that / has compact support.) On the tiny support of f 3 .灰 
ihe slice of /】,* “seen” by can be replaced by its Taylor series, with as 
many terms as are well defined. Since, however, J dx /j,*(a:) = 0, 

this implies that the integral of the product of / and a polynomial of 
order m is zero. We can then vary the k>cations of /,*,**, as given by" 

For each location the argument can be repeated, leading to a whole 
family of different polynomials of order m which all g?ve zero integral when 
nudtiplied with /. Th» leads to the desired moment couditicm. But let us 
be more precise as follows. 

2. We prove (5.5.1) by induction on i. The blowing argument works for both 
the initial step and the inductive step. Assume J dx x n f(x) = 0 for n € N, 
n < £. (If f = 0, then this amounts to no assumption at Since /(’） 
is continuoiis (£ < m), and since the dyadic rationals (j, k €Z) are 
dense in R, there exist J,K so th&t f^(2~ J K) ^ 0. (Otherwise / ⑷三 0 
would follow, implying / s constant if , » Oor 1, which we know not to 
be the case, or, if ^ > 2, / = polynomial of order ^ - 1 > 1, which would 
imply that / is not bounded aod is therefore also excluded.) Moreover, for 
any € > 0 there exists ^ > 0 so that 

e 

/(*) - ^(n!)~ l f^(2~ J K) (x - 2^ J K) n <€|»- 

n=0 J 

if |x - 2~ J K\ < 6. Take now j > J x j > 0. Then 

0 = jdx f(x) f(2ix - 2i^K) ’ 
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=Yl M' 1 f {n) (2~ J K) dx {x - 2^ J K) n Jipx-V-^K) 

n=0 』 

( f t ， 

+ dx f{x) - Y, (n?)' 1 / (n) {2~ J K)(x - 2~ J K) n 

』 n®0 . 

• K^-V^K ), (5.5.2) 

Since J dx x n f(x) - 0 for n < t, the first term is equal to 

( 朽 广 1 f^(2- J K)2- {e+l ^ jdx^Jix). (5.5.3) 

Using the boundedness of the /( n )，the second term can be bounded by 



where we replaced the upper integration bound by oo in the first terra, and 
where we used in the second term that (1 + 2 3 1)^ 1 < (1 + t)" 1 < 

2~ J 爭 （1 + f) 一 1 for t > 6. Note that C \, C 2 only depend cm C, a, and 
they are independent of f, 6, and j. Combining (5.5.2), (5.5.3), and (5.5.4) 
leads to 

\j dx x e f(x) <(£!) [cCi+r°(l + 5) /+1 C 2 ]. 

Here e can be made arbitrarily small, and for the corresponding S we can 
choose j sufficiently large to make the second term arbitrarily small as well. 
It follows that / dx x l f{x) - 0. ■ * 


When applied to orthonormal wavelet bases, this theorem has the following corol¬ 
laries ： 

Corollary 5.5.2. If the = 2 - " 3 - k) coiwtttttte an or- 

thonormal set in L 2 (R), with )V»(x)j <C (l + Ixj) -171-1 '*, ip € C^fR) and iff^ 
bounded for t <m f then J dx x 1 ip(x) - 0 for f — 0, l,***,m. 

Proof. Follows immediately from Theorem 5.5.1, with / = / — 0. ■ 



Remarks. 
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1 ‘ Other proofs can be found in Meyer (1990), Battle (1989). Both proofs 
"work with the Fourier transform, unlUce this one. Similar links between 
zero moments and regularity also constituted part of the “folk wisdom” 
among Calderon-Zygmund theorists, prior to wavelets. 

2. Note that we have not used multiresolution analysis to prove Corollary 5.5.2 
or Theorem 5.5.1, nor even that the t^ Jt k £orm a basis ： ortbonormality 
is the only thing that matters. Battle’s proof (which inspired this one) 
also uses only orthonormality ； Meyer's proof uses the full framework of 
multiresolution analysis. □ 


Corollary 5.5.3. Suppose the are orthonormai. Then ti u tmposstbie 
that ^ has esponenticd decay and that ^ 6 C°° f with all denvahves bounded, 
unless = 0. 

Prbof, 

辦 J; If € C°° with bounded derivatives, then by Theorem 5.&.1, / dx x e il>{x) — 
0 for all , e N; hence ^ 外 _ 0 = 0 for all ^ € N. 

2. If rp has exponential decay, then ^ is analytic on some strip [Im < A. 
Together with = 0 for all ^ 6 N, this implies 功 = 0. ■ 


This is the trade-off announced at the end of the、last section ： we have to 
Choose for exponential (or faster) decay in either time or frequency; we cannot 
也 ave both. In practice, decay in x is often preferred over decay in i ， 

A last consequence of Theorem 5.5.1 is the following factorization. 
Corollary 5.5.4. Assume that the ip Jt k constitute an orthonormal basts 
ivekts, associated with a multiresolution analysva as described tn §5.1. If 
|^(ar)| < C (1 4- and 矽 € C" 1 wth ip ⑷ bounded for £ < m, 

mo, as defined by (5.1.18), (5.1.14), factonzea as 


cyf wav 
.)1， 

~ them n 


^ 讀)=( 

C is 2ir~penodic and € C m . 

1. By Corollary 5.5.2, 卷礼 0 


ffl+1 


切亂 


(5.5.5) 


0 for ^ < m. 


2' OjDt^he other hand, 多⑹ = m^/2 + w) ^/2). Since both 摹 and 
^ are in C" 1 , and ^(0) ^ 0 (see Remark 3 at the end of §5.3.2), this means 
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that mo^is m times differentiable in C 






丌 ， and 

for^ < m. 


3. This implies that mo bas a zero of order m + 1 at ( = ir，or 

/I + c ~<€\ m+1 

Since mo € 0 th , C e C 17 * as well. * 


We will come back to the regularity of wavelet bases in Chapter 7. 

5 . 6 . Connecfion with subband flitting schemes. 

Mtiltiresolution abalysis leads naturally to a hierarchical and fast’scheme for the 
computation of the wavelet coefficients of a given function. Suppose that we have 
computed, or are given, the inner products of / with the 4>j,h At some given, fine 
scale. 12 By rescuing our (or rescaling /) we can assume that the label of 

this fine scale is j = 0. It is then easy to compute the {/, for j > 1. First 
of all, we have (see (5.1.34)) 

^ - ^2 9 h 少 - i ，》 ， 

n 

where 穿 „ =( 垆 ， = (-1)** A_ n +i. Consequently, 

^) t k( x ) - 2' J/J - k) 



菜 2 1 / 2 ^(2** J+1 a: 一 - n) 

n 

= y^gn ^-l t 2Jk+n(a：) 
n 



― ^^9n-*3k * 

n 

(5.6.1) 

It follows tliat 

(/， M =£“(/, 如 ，山 



i.e” the (/, are obtained by convolving the sequence ((/, 知 ,|«)) 喊 2 
(V- n )neZt then retaining only the even samples. Similarly, we have 

(/, = X] (/, 办 -i ,»> ， (5.6.2) 

n 

whidi can b« used to compute the (/, by means of the same operation 
(oonvolution with 芗 ， dedmation by foctor 2) from the {/, if these are 



But, by (5.1.15) 

4>iM x ) 


2~^ 2 ^^x-k) 

^n—2fc t 


(5,6.3) 


whence 


(/, 4>j,k) = 53 h * 《, u ■ 


(5.6.4) 


The procedure to follow is now cle5 ： staiting^ from the (/, 知 ,„》， we compute 
the (/, ^i,*) by (5.6.2), and the {/, ^i,*) by (5.6.4). We can then apply (5.6.2), 

(5.6.4) again to compute the {/, (/, ^ 2 jk) from the {/, ^i jn ), etc...at 

;every step we compute not only the tfavelttt coefficients 《/, ^,*} of the corre¬ 
sponding j-|evel, but also the 〈 /, 虹知 } for 別田 le j-level, which are useful for 

tfae computation of the next level wavelet co^ldeiits. 

The whole process can also be viewed as the computation of successively 
ooaraer approximations of /, together with the difference in “information” be¬ 
tween every two successive levels. In this view we start out with a fine-scale 
approximation to /, /° — Pof (recsdl that P 3 va the cwthogonal projection onto 
V,; we will denote the orthogonal projection onto Wj by Qj) y and we decompose 
/® € K 0 = Vi © W x into /° = Z 1 + 6\ where f 1 - P,/° = PJ 

is the next coarser approximation of / in the multiresolution analysis, and 
b x — /° - Z 1 — Qi/° = Qif is what is “lost” in the transition /° -+ Z 1 . In 
each of these W 3 spaces we have the orthonormal bas^ (<f>j,k)keZi {^Pj,k)keZ^ 
respectively, so that . 

/° = E C n^n, Z 1 

n n n 

Foisxmlas (5.6.2), (5.6.4) give the effect on the oodfidents of the orthogonal basis 
|f traosformation (‘n) n€ z 一（紅 n ， V»i， n )„eZ in % 


4 - hn ~ 2k 4 ， = - 


(5.6.5) 


With the notation a = (on) n€Z , a = (oT^) n€ * and [Ab) k = a 2 k~n we 
can rewrite this as 

c 1 = F c° , d 1 ^ c° . 

The coarser 卵 ximation f l € Vi d^n a^ain be decomposed Into 

/» ^/2+5 2 ,/ 2 e V 2 , 6 2 €^ 2) with 


/ 2 = S c » ^ ^ 


We again have 

Schematically, all this can be represents as in Figure 5.8. 
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In practice, we will stop after a finite number of levels, which means we have 
rewritten the information in ((f t = c° as d 1 ， d 2 , d 3 , - • •, aad a final 

coarse approximation c J , i.e., {{f, ^j,k))keZ,j=i. ,j and Since 

all we have done is a succession of orthogpti^l basis transformations’ the inverse 
operation is given by the adjoint matrices. Explicitly, 

P~ l « 户 +妒 

‘ = 4 ^3,k + 4 ； 

k k ^ 

hence 

: (P~\ 4>^,n) 

— < p )~ l , n ) + 成（也， *， 

k k f 

^ f^n- 2 fc c{ + g n - 2 k di] (5.6.6) 

Jt L J 

(use (5.64), (5.6.3)). 

In electrical engineering terms (5.6.5) and (5,6.6) are the analysis and synthe¬ 
sis steps of a svbband JUtermg scheme with exact reconstruction. In a two-channel 
subband filtering scheme, an incoming sequence (c^)„ € z m convolved with two 
different filters, one low-pass and one high-pass. The two resulting sequences 
are then subsampled, i.e., only the even (or only the odd) entries are retained. 
This is exactly what happens in (5-6.5). Fot readers unfamiliar with this w filter- 
ing*' terminology, let me explmn briefly what it meeuis. Any square summable 
sequence (c„) n€ z can be interpreted as the sequence of sampled values 7 (n) of 
a bandlimited function 7 with mipport 7 C [-tt, it) (see Chapter 2), 
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The result is another bandlimit«d function, 0 * 7 , 



(ot ”) A (0 = 去 E a n ^ m Cm , 

n€Z mez 

or 

(Q^ 7 )(:r) = £ 如 -mQ) n) n) - 

The filter is low-pass if a|j_ w ^ is modtly concentrated on [-tt/ 2, tr/2], high- 
pass if a|j„ w w j is mostly concentrated on {4; ir/2 < ]^| < ?r}; see Figure 5 9. 
The “ideal” low-pass and high-pass filters are dtt(C) — 1 if |^i < tt/ 2, 0 if 
7 r /2 < |^{ < ir, and a w (0 = 0 if |^( < k/2, l if ir/2 < ⑷ < tt, respectively. The 
corresponding a n (as in (5.6.7)) are given by 


aj = 


0 * 

(- 1 )* 
(2k + 1 )tt 


0 

(- 

(2k^l)n 


for n 0 , 

for n — 2k, fc _ 0 ， 

fen* n = 2A; + 1 , 

for n — 0 , 

for rt = 2k t k ^0 , 

for n = 2fe + 1 * 



Pig. 5.9. A low-past fitter (»ohd Une) and a higk-pa»» filter (dashed itnc) 

When the ideal low-pass filter is applied to 7 , the result is a bandlimited 
function with support c [-ir/ 2 , 霄 / 2 ]. Sodia function is completely determined 
by its sampled indues in 2Z, and we have (see (2.1.2)) 
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Similarly, the result of applying the ideal high-pass filter to 7 is a frequency- 
shifted version of a bandlimitcd function with support C 卜賞 /2, ir/2]. Such a 
function is again completely det^inined by its sampled values on 2Z T 


= i ^ ^ 4 n _ m e-M 


E 


sin [n(x - 2n)/2) 
it{x - 2n)/2 


{2cos(ir(x - 2n)/2] - 1}. 


Since the even-indexed entries of the convolutions of the a^, with the c* 
suffice to characterize at * 7 and * 7 completely, it makes sense to retain 
only them after the convolution. This is the rationale behind the decimation by 
a factor 2 in subband filtering, also called “downsampling.” Reconstructing the 
original Cm from the two filtered euod decimated sequences, 


c n = a 2 n-m ^m ， C n ^ , (5.6.8) 


is easy ： 

Cm = l{jn) = (a L * 7)(m) + {a H * 7)(m) 


(since a L + an = 1) 


Y'' sin[7r(m - 2fc)/2| 

^ 丌 (m - 2k)/2 


{ci + cjl (2cos(7r(m - 2k}/2\ - 




Distinguishing between even and odd m, we find 

c 2m — c m + ^ > 

C2m+1 = X) dr c m-<) - 


This ccA also be rewritten as 

Cm = 2 «-2n c i + a m-2n c n f ) - (5.6.9) 

n 


This last operation can be seen 明 the result of 

• interleaving both the cj and with zeros (i.e., constructing new se¬ 
quences with zero odd e^fcrie^ and with even entires given by the con¬ 
secutive cj, c^); 

• convolving these interleaved ( K upeampled w ) sequences with the filters o L , 
a 11 , respectively; 


• adding the two results. 
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Schematically, (5,6.8) and (5.6.9) can be represented as in Figure 5.10. 

The filter coefficients aj, a? for the ideal low-pass and high-pass filtero 
a L ， a H decay much too slowly to be useful. In practice, one prefers to use 
the scheme in Figure 5.10^ with fitters a 0 ，^ 1 ，^ 0 ,^ 1 with much faster decaying 
coefficients. This can only be achieved if the corresponding 2w-periodic func¬ 
tions a 0 ,^ 1 ,^ 0 ,^ 1 are smoother than a L , a 11 . This means aliasing can occur: 
ja u j, ja 1 } look like “rounded” versions of a L t cfi (as in Figure 5.9), which means 
their support is larger than [-^/2 , tt/2 ] and {《； ir/2 < |^| < ir}, respectively. 
Consequently, a 0 * 7, a 1 * 7 are not truly baadlimited with maximal frequency 
?r/2, and sampling them as if they were leads to aliasing, as explained in §2.1. 
This has to be remedied in the reconstruction st^ge: 5°, a 1 need to match a 0 
and a 1 to get rid again of the biasing present after the decomposition. And even 
this “matdilng” is only po^ible if a 0 and a 1 are already mc^ched in some way. 
To 6nd the appropriate conditions on these filters’ it is convenient to use the 
“2-notation，” in which a sequence (^) n€ z is presented by the formal series 
a(z) = ^ zn - If 2 = is on the unit circle, then this is nothing but 

a Fourier series; sometimes it is convenient to consider general 2 G C rather than 
\z\ — 1. The decomposition stage of the subband filtering scheme in Figure 5.10 
can then be written as 

c°{z 2 ) = i [a°(z)4z) + a°(-z)c(-z)] , 

c J {z 2 ) = 5 [a}{z)c{z) + a 1 (— r)c(-^)] ■ 

Here a°(z)dz) is the ^-notation for the convolution of a 0 and c; |[6(z) + 5{-z)] 
is equal to the formal sequence z2n y >*®-» H z ) with all the odd entries 

removed. 

The reronstruction stage is 

c{z) = + aW(z 2 ) ， 



Fig. 5.10. Schematic r^ruentaiion of the deoemposiiion and reeorutrwAian stages 
(separated by the vortical dashed Ime) m a tubband JQbarvng scheme. Every letter (o°, o 1 ,-- ) 
m a box represents convolution unth the corretptmding aequcnce; 2 i atanda for the downsam¬ 
pling by 2 {ntatning only the even efttrie*}，2 T for by 2 (interleaving vnth zeros). 

In the "idad" cue, o° = a L , a* = a 11 1 o° =? 2a L , and a 1 ?= 2a M ; the final result is identical 
to the c = c. 
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- or(-z ), 

= a°(z) , (5 .氏 12 ) 

;— 2 ) > 


so that (5.6.11) is indeed satisfied, and (5-6.10) simplifies to 
^ c(^) = \ (a°(z ) 2 - a°(-^) 2 l c{z ). 

If. a 0 is symmetric, a° n = aj, then a 1 ^) = aie~ ,nf is the 

“mirror” of a 0 with respect to the “half-band” value ^ = jt/ 2 , since 
― En a n (~l) n e~* n€ — a°[n -《).Filters chosen as in ( 5 . 6 . 12 ) 

are therefore called “quadrature mirror filters** (QMF). In practice, one likes 
to work with FIR filters (FIR = finite impulse response; this means that only 
finitely many a n are nonzero). Ui^brtunately, there exist no FIR a 0 so that 
a°(z) 2 - a°(~z) 2 — 2, so that c cannot be identical to c in this scheme. It is 
nevertheless possible to find a° so that aP(z) 2 - a°(-z) 2 is dose to 2 , so that 
the output of the scheme is indeed close to the input. There is by now an im¬ 
mense literature on the design of various QMF; see the issues of IEEE Trans. 
Acoust. Speech Signal Process, for the last 15 years. There also ex^t many 
generalizations to splitting into more than 2 bands (GQMF^^-gener^ized QMF). 

In Mintaser {1985)，Smith andBato^U (1 ■ 蝴 5)，and Vetterli (19SS) a scheme 
different from ^ 5 . 6 . 12 } was proposed ： 

a l {z) ^ . 

oP(z) *= , ( 5 . 6 . 1 ®) 

a l {j：) = = za°(-z). 

t ^ 

It is easy to check tb^t this salwfies again (5.6.11), and that (5.&1Q) becomes 

£(z) = I 4z) • : 


Where c^(z 2 ) is the ^-notation for the upsampted version of c? (zeros have been 
interleaved: cP{z 2 ) — z 2n ). Tire total effect is 

c{z) ^ 5 [a°{z)a°(z) + c(z) 

* [a°(3 ： )a 0 (-2) + c(- 2 ) . (5.6.10) 

In this expression, the second term contains the aliasing effects: c^—z) corre¬ 
sponds to a shifting of the Fouriesr series Cn by n, exactly wbat you 
would expect from aliasimg due to sampling at half the Nyq^ist rate, la order to 
eliminA^ aliasing, we therefore need ' t 

- d°(z)a Q {-z) + d l (z)a 1 (~z) = 0 ： ' (5.6.11) 

The first subband coding schema without aliasing date back to Eateban and 
Galand (1977). In their work, as in most sdiemes that will be considered in 
these notes, the sequences axe real; they dioose 


VJ, 

/\ /i /\ 
ltt'-oa'a 1 
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For z — e * 石 and real aj, the expression between square brackets becomes 
\\\a°(e-^)\ 2 f !a°(-e"*«)| 2 ] = i[|a°(0| 2 + |« 0 (( + 冗 )| 2 ). There now exist FIR 
choices of a 0 for which this is exactly 1, so that we have exact reconstruction in 
the subband filtering scheme. Smith and Barnwell (1986) named filters chosen as 
in (5.6.13) 13 “conjugate quadrature filters" (CQF), but the term has not become 
as generally popular as QMF. 

One last remark before we return to wavelets. The whole purpose of sub¬ 
band filtering is of course not to just decompose and reconstruct: a simple wire, 
instead of the scheme in Figure 5.10, would be far cheaper and more efficient. 
The goal of the game is to do some compression or processing between the de¬ 
composition and reconstruction stages. For many applications (image analysis, 
for exam^e), compression after subband filtering is more feasible than without 
filtering. Heconstruction after such* compression schemes (quantization) is then 
not perfect any more, 14 but it is hoped that with specially designed filters, the 
distortion due to quantization can be kept small, although si^oificant compres¬ 
sion ratios are attained. We will come Jback to this (albeit teiefly) in the next. 


chapter. 

Back to orthonormal wavelet bases. Formulas (5.6.5), (5.6.6) have exactly 
same structure as (5 6.8), (5 6.9), respectively. Going from one level in a 
tt^Curesolution analysis to the next cows^ level and the corre^onding level 
^wavelets, and then doing the reverse operation, can thCTefwe be represented 
by ^ diagram similar to Figure 5.11. Here (h) n = h_ nt (g) n = (see 
above). If we assume that the h n are real, and if we also take into account that 
g n = (—l) n h_ n+ i, then we can identify Figure 5.11 with Figure 5.10 with the 
choices 


a 0 ( 2 ) = hiz^ 1 ) , a Q (z) = h(z ), 

a l {z) =* g{z~ l ) — —z~ l h(~z) , o}(z) = g(z) «= *-zh{—z ~ l ). 

Up to a trivial sign change m a 1 and a 1 , this corresponds exactly with (5.6.13). 
This means that every orthonormal wavelet bases associated with & multires¬ 
olution analysis gives rise to a pair of CQF filters, i.e., to a subband filtering 
scheme with exact reconstruction. The revere is not true: in an orthoaormal 
basis construction we necessarily have a°(l) — h n = 2" 2 (see Remark 5 at 
the end of §5.3.2), but there exist CQF for which a^(l) is close to, but not equal 
to, 2 1 , 2 . Moreover, ail the examples of orthononnal bases we have seen so far 
correspond to infinitely supported ♦ 替 ， and hence to uon-finite sequences h n \ for 
applications, FIR filters are preferred. Is it possible to construct orthonormal 
wavelet be^es corresponding to finite filters? What does it mean for these filters 
to conresp<»id to, e.g” regular wavelets? How can wavelets be useful in filtering 
contexts? All these are questions that will be addressed in the next chapter. 


l. I choose here the same nesting order (the more negative the index, the 
larger the space) as m the ladder SoboAev spacer This » him order 



t$re«oIutton analyau. 


i 沪 

that follows tiaturally from the notation of non-orthogonal wavelets as ini¬ 
tiated by A. Croesmann and J. Morlet. It is non-standard, however: Meycf 
(1990) uses the reverse ordering, more in accordance with established prac¬ 
tices in harmonic analysis. For applications in numerical analysis, Bey Hein, 
Coifman, and Rokhlin (1989) find the ordering presented here the most 
practical. 

2. We impose here no a priori regularity or decay on 沴， unlike, e.g., Meyer 

(1990). ^ 

3. Equation (5 丄 33) characterizes' ail the possible 矽 # . This foUows from 
Lemma 8.1.1 in Chapter 8. 

4. In case 沴 has compact support, and we would like 畛 to have the same 
compact support, (5.1.35) is the only possible choice. 

5. It is generally believed that there is no such ^atholc^ical" example with 
continuous Another ch^lenge for the reader! 

When this book was in its last stages, I heard that Lemad4 (1991) has 
proved that if tp is compactly supported (continuous or not), then it is 
automatically associated ^ith a multiresolution analysis. Hiis solves the 
open problem for one very impOTtaat special case. 

8. Note that thae exists ^ e H so that the are an orthcmonnal bo«8 
for Vo and <f>* € L 1 (R), unlike It suffices to take 多 # «) = A($) 多 (《)， 
where 入 is 27r-periodic and = sign(^) - e^ 2 for < ir. This 4^ 
is again a Schwartz funcyoti. same Hilbert transfonfi tridc can be 
applied toother multiresolution analyses, such as the Battle-Lemari^ case 
or the constructions with ccnnpactly supported 欢 in the next chapter . 、 

7. If we impose that ^ u continuoi» at ^ = 0, then mo dbes determine i 

t uniquely. ‘ 

8. The oootmuity of ^ together with 多⑼ / 0, impllie that mo(0) 1 and 

that mo is oontinuous in $ = 0. It fellows that mf is continiious in ^ = 0. 
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Since ||7*^(^)| 2 4- |m^(^ + ir) 卩 =1, it follows that |tn^j is continuous 
in 《 =tt Consequently, |^(^)| =s [mf (4/2) -f tt)| |0(^/2)f is continuous 
in ^ - 0 since ^ has to be admissible, this implies ttIq (7r) = 0; hence 
mo(7r) = 0 This provides another derivation for (5 3.20). 

9. Proof We prove that [ C 2 n = i - X] c 2 n+i <=> 5Z/ <f>(x - t)~ const. 〆 0 
if I 於 ( 工 )| < C(1 + |a|) -1 — e and 0 is continuous 

=» Define f(x) - <f>{x - i). The conditions on <j> ensure that / is well 

defined and continuous We have 

f(x) = JZ 51 r n <f>( 2 x - 2^ - n) * 51 ^ <K 2 ® 一 m ) 


- 53 (12 1 ^ -爪卜 X) 炎 ( 紅 - ， m) = f(2x) ‘ 

\ j / m 

Hence / is continuous, periodic with period 1, and 
f{x) - f{2x) = ■• = /(2 n x)= 

It follows that / is constant. 

= c implies 4>(2wn) = 6 n0 (2 霄广 c. But 4>(^) — 
' moim m2)\ hence 

0 = 彡 (2w(2n+l )) 二 mo(7r(2n+l)) ^(?r(2n+l)) = mo(?r) <^(7r(2n+l)), 

If mo(7r) / 认 then 4>(n{2n + 1)) = 0 would follow for at! n € 2, 
in contradiction with Y, l $( 貫 + 27rn)J 2 > 0. H^ice mo{7r) «= 0 t or 

2 c 2n - 1 = 52 C 2 n+ 1 - * 

10. An easy way to compute the Fourier coefficients of | 在 + 2?r 《) 卩 is the 

following ： 

去乂 ’ 炎 W 幻抑 + 2W)| 2 = i/:^ e 叫咖 I 2 

X 严 _ 

~ 2 ~~ J 血多 (®) 沴 (® — n). 


For B-splme these 
explicit formula. 


to compute; 


Chui (1992) for an 


11. Proof. f(y) ^ f(x) + / x v dz f(z) 
=> for 0 < y < 27 t, 


f(y + 2irt) = J dx f(m + 2ir£) + j dx j dz f r (z + 2nt) 

一广 dx j: dz f(z + 2ntj 
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^i/(y + 2^)i<^ / 2 2 :尸 +1) 血 |/W| + C 1 ) 心 l/WI 
Hi\f(y + 2^)1 < (2tt)- 1 fdx\f(x)\ + /dx \f(x)\ . • 

12. If / is given in “sampled” form, i.e., if we only know the /(n), then the 

inner products (/, 0o,n) can be computed .by a convolution (or filtering) 
operation, under the assumption that / € Vo to start with (components of 
f orthogonal to Vo cannot be recovered). We have/ = (/，00,*) 必 o,fc; 

hence f(n) - 2*. (/ > ^o.Jt) </►(« - k). Consequently, 

i.e., the (/， 如, *) are the Fourier coefficients of /(n) e~ ,n ^) 

(Em H m ) It follows that {/, <h,k) = Ert a k-n /⑻， where 

a m =*(27r)~ 1 fj e*»« 

13. For convenience, they chose a^z) — z 7N ~ l a°(-z~ 1 ), o 0 (^：) = z 2N a°(« -1 ), 
0 *( 2 ) = za°(-z) rather than (5.6.13), with N e Z picked so that ail 
the a 3 , a 3 are polynomials in z (no negative powers). One finds then 
c(z) ^ z 2N c(》), which corresponds to a pure delay in the reconstruction. 

14. This is an argument used fans of the Esteban-Galand-type QMF filtere： 
these fail to give exact reconstruction frcan the start，but their deviation 
from exact reconstruction can be made small in comparison with distortions 
iirtroduced by quantization. 



n V fc / \ m 



CHAPTER 6 _ 

Orthonormal Bases of Compactly 
Supported Wavelets 


Except for the Haar basis, all the examples of orthonormal wavelet bases in the 
previous chapter consisted of infinitely supported functions, as a result of the 
orthogonfdization trick (5.3.3). To construct orthonormal examples in which 矽 
is compactly supported, it pays to start from mo (or, equivalently, from the sub* 
band filtering scheme—see §5 6) rather than from <t> or the V 3 . In §6.1 we show 
how to ccoistruct mo so that (5.1.20) is satisfied as well as (5.5.5) for some N >0 
(a necessary condition to have some regularity for 垆 ). Not every such mo is asso¬ 
ciated to an orthonormal wavelet basis, however, an issue addressed in §§6.2 and 
6.3. The main results of these two sections are summarized in Theorem 6.3.6, at 
md of §6.3. Section 6.4 contains examples of compactly supported wavelets 
orthonorm^ bases. The orthonormal wavelet bases thus obtained 
cannot^ in general, be written in a dosed analytic form. Thdr graph can be 
computed with arbitrarily high precision，viaap algcmthm that I call the Cas¬ 
cade algorithm, n which Is in fact a u refinenifflit scheme” as uBed in com|Hiter 
aided design. All this is discussed in §6.5. 

A lot of this material goes back to Daiibe ( 站播 （ 198 胁 )； for many of the re¬ 
sults, better, simpler, or more general proo£s have been found since, and I have 
given preference to these new ways of looking at things. These different ap¬ 
proaches aie borrowed mainly from (1^9)^ Cohen (1990), Lawton (1990, 

1991), Meyer (1990), and Cohen, Daubedues, and Feauveau (1992); for the link 
with refinement equations the r^erencea are CavftreUa ， Dahmen, abd MicchelH 
(1991) aad Dyn and Levin (1990), as well as «arSer i^ers by these authors (see 
§6.5). ^ 


6.1. Construction of mo* 

In this chapter we are xoamly interested in constructing compactly supported 
wavelets 必 . The easiest "way to ensure compact support for the wavelet ^ is 
to choose the scaling function (f> with support (in its orthogonalized 

version), tt then folio 和 t &om the defix^Ki^of the 


hj^y/2 J dst 狄 x) ^(2*-n), 


m 
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that only finitely many hn are nonzero, so that reduces to a finite linear 
comblnati(m of compactly supported functions (see (5.1 34)), and therefore au¬ 
tomatically has compact support itself. Choosing both <t> and 矽 with- compact 
support ^so has the advantage that the corresponding subband filtering scheme 
(see §5.6) uses only FIR filters. 

For compactly supported <t> the 2ir-periodic function ttiq, 

mo(0 = ^ E ^ e " tn€ ^ 

becomes a trigonometric polynomial. As shown in Chapter 5 (see (5.1.20)), 
orthonormality of the 如 , n implies 

|mo(0 卩 + |moK+7r)| 2 = 1 , (6.U) 


where we have dropped the “almost everywhere” because mo is necessarily con¬ 
tinuous, ^ that (6.U) has to hold for all ^ if it holds a.e. " 

We are also interested ia making ^ and 4> reasonably regular. By Corol¬ 
lary 5.5.4, this means that mo should be of the form 


mo(4) 


m 


m 


( 6 . 1 . 2 ) 


with iV > 1, and £'a trigonometric iwlynoznial. Note that even without reg¬ 
ularity constraint, we aeed (6.1.2) with N at least l. 1 Putting (6.1.1), (6.1.2) 
together, it follows that we are looking for 


M»(0-|mo(«| 2 

a polynomial in cos 笱 ， tetisfying 

峋 K) + M)K + ir) : 
md 


Mod) * ( ⑽ 2 塞 ) 祕 ) ， 


(6.1.3) 


(6.1 t 4) 


(6.1.5) 


conve- 


where £r(^) = |£(《)| 2 is also a polynomial in cos《. For our purpose it is 
nient to rewrite L(^) as a polynomtai m sin 2 ^/2 = (1 — cob^)/2, 

Mo(«= f 广 P ( 如 * f) • ( 61 . 6 ) 


In terms of P, the constraint (6.1.4) becomes 

(1 - y)^ P(y) ^y N P(l-y)-l, 


(6.1.7) 


which should hold for all y € [0,1], hence for all y € R. Tb solve ($.1.7) few P 
we use 


Bezoufs theorem. 2 
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THEOREM 6.1.1. If pu P 2 are two polynomials, of degree n iy n 2 , respec¬ 
tively, with no common zeros, then there exist unique polynomiaU 矾， qz, of 
degree - 1 , ni - 1 ， respectively, so that 

Pi(x) 9 i(x) + pi(x) qz(x) = 1 . ( 6 . 1 . 8 ) 

Proof. 

1. We first prove existence; uniqueness follows later. We can assume that 

ni > «2 (by reaumbering, if necessary). Since degree (p 2 ) < degree (pi), 
we can find polynomials hM* with degree ( 02 ) = degree (p!) - 

degree (p 2 )，degree ( 62 ) < decree ^), so that 

Pl(x) - 02 (x) P 2 (x) + ⑷. 

2. Similarly, we can find o 3 (i), ^(x), with degree ( 03 ) = d 雄 ree(pa) 
—degree ( 63 ), degree ( 63 ) < degree ( 62 ), so that 

Pa(x) = a 3 (x) M^) + & 3 (ar) ■ 

We keep going with this procedure, with d B _i taking the role of pj in this , 
last equation, and b n the role of 

5n-l ( 工 ） ^ ®n+l(:) 5n(:) + 办 ■ 

Since degree (d n ) is strictly decreasii^, this has to stop at 恥 me point, which 
Is only possible if — 0 for some N t with 6 况 / 0， 

6 ^v_i(a;) = a~+i{x) b N (x) • 

3. Since 

6^-2 = as 6 yv-l +^N » 

it follows that 6 jv divides 6 /V -2 as weU. By induction divides all the 
previous 6 »’ and so that bs divide both pi and P 2 . Since p\ and p 2 
have no zeros in common, it follows tjbat is & constant difierent &om 


6/v_2 - dN bfj-i = bs-2 - - 3 - ^n-i ^n-s) 

{1 + £»汉 ajV-l)^N -2 - aw ^N-3 

etc.... 

* 二 

frjv — a AT,* f>N^k + ^N,k fejV-Jk-1 , 

with OjNT t i = -Oiv, CLN t x = 1, 5iV,fc+l = «JV,Jfe - 0>N t k AjV-fc, flJV T Jfe+l = «N,k* 
It £(dlow8, aguzi by Induction, that degree(owfc) = degree (ijv^fc_i)- 


4. We have now 


By induction 
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degree ( 6 ^ 1 )， degree (a at, it) = degree (&"_*) - degree For 

fc = - 1 ， we find 

— P2 + Pi , * 

with degree (ajy rW _i) = degree (pj) - degree( 6 ^_j) < degree 
degree(a N , at- i} - degree^) - degree< degree(p 2 ). (We have 
used that degree (6jv_i> > 1; if degree (6yy-1) were 0, then would be 
zero.) It follows that qi = &N,N-i/b N , q 2 = solve (6.1.8) and 

satisfy the desired d^ree constraints. 

5. It remains to establish uniqueness. Suppose 仍，取 and 电 are two 
solution pairs to (6,1.8)，both satisfying the degree restrictions. Then 

PiUi — 办 ） + Pz(92 - 72 ) = 0 . 

Since pi ， P 2 haw no zeros in common, this implies that every zero of pj is 
a zero of qi - ?i, with at least the «ame multiplicity. If qi / q\ % then this 
means degree ( 讥 -^fi) > degree(P 2 ), which is impossible since degree ( 仍 ）， 
degree(^i) < degree (^ 2 ). Hence 91 = It then follows immediately that 
92 = ^2 ■ 

Remarks. 

1. For later convenience (Chapter 8 ), we have stated Bezoufs theorem in 
greater generality than needed in the present diapter. In fact, it bolds un¬ 
der even more general ccmdltioas: ifpi and P 2 have zeros in common, then 
( 6 . 1 , 8 ) can still be solved if its right-hand side is divisible by the greatest 
common denominator (g.c.d.) of pi, P 2 . The proof is still the same, but 
bpf is now the gx.d. of pi, P 2 instead of a constant. The argument in the 
proof is nothing but the construction of the g.c.d. by Euclid’s algorithm; 
it works in many other frameworks than the polynomials (in any graded 
ring, in algebraic terminology). 

2. It Is clear from the construction of pi, pa, that if pi wd P 2 hnveoafy ratio¬ 
ns coefficients, then so will and q^. This will be useful in Chester 8 . o 

Let us now apply this to the problem afe hand, Le., (6.1.7). By Theorem 6 .M 
there exist unique polynomials qj, 92 , of degree < JV — 1 , so that 

(1 - y)%(y) + y% 2 (y) = 1. (6.1.9) 

Substituting 1 - y for y in (6.L9) leads to 

(1 — y) N «»{l -y) + /^i(l -1/) - 1 ; ' 

the uniqueness of qi ， 取 thus implies = ^i(l ~ y)> It follows that P(y)= 
gi(y) is a solution of (6.1.7). In this case, we can find the explicit form of 
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without 


using Euclid^ algoritbiii: 

gi(y) * 

- E d _ V +0 (，)， 


have 


Jfc =0 


wnere we nave written out expuauy tue nrst is terms oi tne xayior expansu 
for (1 - y)~ N . Since degree^i) < N - i, q% is 句 ual to its Taylor expansic 
truncated after N 


h or- 


9i(y) 


N-l 

E 

Jt=0 


(N + k 

l k 


v k . 


This gives an explicit solution to (6.1,7), (Fortunately, it is positive for y € (0,1], 
so it is a good candidate for |£(《)| 2 .) It is the unique lowest degree solution, 

however : 


which we will denote by Pjv. There exist 


many solutions of higher 


degree. For any such hi^ar degree solution, we have 

[Piv) - PN(y)\ + y^(i 一 ») 一 Psii -y)l-o. 

This already implies that P — Pjv is divisible by y N t 

P(y) - ^V(y) - y N Pi^f) > 

Moreover, 

户 (!/) + 户 0 l ) 吨 „ 

i.e., P is antisymmetric with respect to We caa summarize all our findings as 
follows. 

PROPOSITION 6.1.2. A trigonometric polynomial mo of the form 


mo(4) 




m 


V 2 ； 

satisfies ( 6 . 1 . 1 ) if and only if L(i) — |£ ⑹卩 con 6 c written as 

e/2), 


( 6 . 1 . 10 ) 


y/here 


P(y)^P N (y) + y N 

= E ( w - fc 1 + ”v* 

*=0 \ 7 


( 6 , 1 . 11 ) 

( 6 . 1 . 12 ) 


and R is an odd polynomial，chosen such that P(y) > 0 /or y 6 [0,1], 



172 


OIAPTER6 


This proposition completely diaracterizes |mo(^)| 2 - Bbr our jm^poses we seed 
however m© itself, not |mo| 2 . So how do we "extract the square root* fr<Mn LI 
Here a lemma by Riesz (see Polya and Szego (1971)) comes to our help. 

Lemma 6.1.3. Let A be a positive trigonometric polynomial invariant under 
the substitution— A is necessarily of the form 

M 

^(4) = 52 °m cosm^, with Om € R ， 

m=0 

Then there exists a trigonometric polynomial B of order M f i.e” 

Af 

B(i) =Yl b ^ with bn, 


m=0 


such that I 丑 (0 卩二 ^(4)- 


Proof. 


We can write j4 (《）=^(008 $), where pA is a polynomial of degree M #H;li 
real coefficients ‘ This polynomial can be factored, 

M 

p 4 (c) =a JJ (c-Cj) t , 

t 

in complex duplets c J t Cj t or in real 


where the zeros 
singlets. We can also write 

A{0=^e^ P A (e-^) t 

where Pa is a polynomial of degree 2M. For | 方 | = 1 T we have 

M 

pa { z ) ^ i — o — c? 


M / , 

i-i x 

a U (|- c ^+^ 2 ) j 


(6.1.13) 


the two polynomials in the 由 l~ and left-hand sides of (6.1.13) th^efore 
agree on all of C. 

2. If Cj is real, then the zeros of | — c^4r+|z 2 atecj ± yjc^ - 1. For \cj\ > 1, 

these are two real zeros (degien^ate if Cj = 士 1) of the form r Jt rj l . fbr 
\cj\ < 1, the two zeros are complex conjugate and of absolute value 1， i.e” 
they are of the form e* 9 ^ c _<aj . Sfaioe \cj\ < 1, such zeros correspond to 
*^hysical n zeros of A (i.e” to values of ^ for which = 0). ii order 
not to cause any contradiction with A > 0, these zeros must have even 
multiplicity. 
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3. If Cj is not real, then we consider 


ther with Cfc = The poly- 


it togeti 

nomial (| - CjZ 4- |z 2 ) (| - CjZ + ^z 2 ) has four zeros, c， 土 \ and 

Zj ± — 1. One easily diedcs that the four zeros are all different, and 

form a quadruplet Zj, z^* 1 , z 31 1J 1 . 


4. We therefore have 


Pa{z) — 2 ° w 


n ( 2 ~ ( 之 - 芝 i )( 卜 


■ L 


where we Imve t^rmiped the two diflferent kinds of zeeoe. 

5. For z — c~*^ on the unit circle, we have 

|(e - 试 - Zo)(e~^-z^ l )\^ \zo \~ 1 je~^ - zo \ 2 -: 
Consequently, : 

Am - we\ - me^)] 

K 1 I 


n \z 3 r 2 flw- 1 

i=a fc=i 


K 


2 

L 

n(e 丈 # 
fe=l 



JJ(c - r e ) 
/ =1 


where 


B(0 


-剛 I 2 , 


Um ~ 2 n^r 1 


1/2 


\{(e^ - 


i=l fc=i 

K L 

JJ(c~ 2<4 - 2€~^cosa^ + 1) - - r，) 

fc^i t-\ 


is clearly a trigonometric polynomial of order M with real coefficients. 
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chapter 6 


1 ， This proof is constructive. It uses factorization of a polynomial of degree 
Af, however, which has to be done num^ically and may lead to problems 
if M is large and some zeros are close together. Note that in this proof we 
' need to factor a polynomial of degree only Af ，unlike some other procedures, 
which factor directly Pa, a polynomial of degree 2M. 

2. This procedure of “extracting the square root tt is also called spectral fac¬ 
torization in the engineering literature. 

3. The polynomial B is not unique! For M odd, for instance^ Pa may have 

quadruplets of complex zeros, and 1 pair of real 城 In each 
quadruplet we can choose to retain either z 3 , Zj to make up B, or zj 1 ^ z~ l \ 
in each duplet -we can choose either r t or r^ 1 . This makes already for 
2( m + i )/2 different choices for B. Moreover, can always mu}t4>ly B with 
c ,n ^, n arbitrary in Z. o 

Together, Proposition 6.1.2 and Lemma 6.1.3 tell 助 how to construct all the 
possible trigonometric polynomials m 0 satisfying (6.1.1) and (6.1.2). It is not 
yet clear, however, whether any such rno leads to m ortbonormal wavelet basis. 
In fact, some do not* This will be discussed in the next two sections. Readers who 
would like to skip most of the technicalities cap find the main results summed 
up in Theorem 6.3.6 at the end of §6.3. 

6.2. Correspondence with orthonormal wavelet bases. 

We start by deriving a formula for a candidate scaling function 0. Once this is 
done, we will check when this candidate defines indeed a bona fide multiresolution 
analysis. 

If a trigonometric polynomial mo is associated with a multiresolution analysis 
as in §5.1, and if thje corresponding scaling Unction ^ is in L 1 (R), then we know 
that for all ^ 

m^rnoimkm- ( 6 - 2 . 1 ) 

(See (5.1.17). Continuity of ^ and mo allows us to drop the “a.e.”) Moreover, 
we know from Remark 3 foUowing Propowtkm 5.3.2 that necessarily ^(0) ^ 0, 
hence mo ⑼ =1. Because of (6.1.1) thi9 i» turn implies mo(^) = 0. It follows 
that, for all Ji; € Z, ^ ^ 0, 

^{2kv) = 0(2 2^(2m + l)7r) (for some ^ > 0, m 6 Z) 

i 

JJ m 0 (2 /+1 ~ J (2m + l)ir) mo((2m + l)ir) $((2m + 1) 赏） 

ss mo ( 丌） i((2m + 1)，）= 0 , 
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jSince |多(《+ 27!^)卩 = (2tt) _ 1 (see (5.1，19))，this fixes the normalization of <j>\ 
|^(0){ = (2贫 ) -1 / 3 , ot \fdx 沴 (1)1 = 1. It is convenient to choose the phase of 4> 
so that / dx 0(x) = Taking all this into account, it follows from (6.2.1) that 


0(0 = w 1/2 n m 0 ( 2->0 . 


( 6 . 2 . 2 ) 


This infinite product makes sense: since [/in||n| < oo, and mo(0)= 
mo(0 = 2 _1/2 satisfies 

|mo(OI S 1 + l^no(0 - 1| < 1 + \h n \\B\n n^/2| < 1 + C\i\ < e c,cl 


hence 


n <exp E C|2 -弋 I 卜⑽ 


t 


y. The infinite product in the right hand side of (6.2.2) therefore converges abBo- 
^e!y and uniformly on compact sets. 4 

Ail this applies generally whenever <t> € and the h n have sufficient decay. 
In our present case, mo is a trigonometric polynomial (only fiuitdy many of the 
different from zero), and we are looking for 必 with compact support. 
Ti^ther with the obvious constraint ♦ £ L 2 ' compact suf^ort for 硪 means 
0 G L 1 , so that the above discussion applies. It follows that (6.2.2) is the 
only possible candidate (up to a constant phase factor) for the scaling function 
corresponding to a trigonometric polynomial mo constructed ai in $6.1. We now 
need to check that ^ satisfies some basic requirements for a scaling function. 
First of all, <f> is square integrable: 

Lemma 6.2.1 ‘ (Mallat (1989)) If mo is a 2ir-periodic function sattsfymg 
(6.1.1), and tf(2ir)~ 1 ^ 2 flj^i m 0 (2*' J ^) converges pomtwise a.e. t then its limit 

iiO M in and \[<f >\\ L 2 < L 

Proof. 

1. Define /*(《）= 伽广" 2 (^ =1 吻(2—《)]欠卜― d)，where 
X|-ir t ir)(C) = 1 |CI < 7T, 0 otherwise. Then /* — *■ 4> pointwise a.e. 

2. Moreover, 

卜 - w 1 /: 二炎 n k ^ oi 2 

= {2ir)~ l I JJ |mo(2~^)| 2 (by the 2ir-periodicity of mo) 



176 


CHAPTER 6 



n k »( 2 h 2 

j-i 


翁 1 fW 铆 


[|mo(2' fc O| 2 + I 吻(2-\ + ff)| 2 ] 

(by tf.1.1)) 


3. It follows that, for all 

liA!l 2 -ll/ fc -ilt 3 = --- = ll/oil 3 = i. 
Consequently, by Fatou’s lemma, 

J |0(O| 2 < lin^sup J |/*(«| 3 < 


Second, since r/io is a trigonometric polynomial, the following lemma borrowed 
from Deslauriers aud Dubuc (1987) proves that 4 has compact support. 

Lemma 6.2.2. // T(C) = In e~ tni , with ： h then 

fljti r(2^4) w an entire function of exponential ti/pe. In particiUar t it m 
the Fourier transform of a distribution with support m INuN^]. 

Proof. By the Pdley-Wiener thee 肪 m for distributk^is, it is sufficient to prove 
that fl* x r(2”《）is an entire function of exponential type with bounds 


n r(2"^e) < 0,(1 + exp(M jlm^l) for Im 4 > o , 

A r ( 2 ~ 3 0 ^ exp (iV 2 |Im^|) forlm{<0, 


for some C\, Mi, We will only prove the first bound; the second is 
entirely analogous. Define 


、 m) = r(0 = 7n + N, . 

n 游 0 

Then OO oo 

J]r( 2 ^e)«e-^n ri < 2 '^' 

j=i „ , 

so we only need to prove a polynomial bound for fljli ri(2 -J 0 lor Iqq ^ ^ 0. 
For Im C > 0 we have 

1^(0-1| < hn+Njte-^-H 
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N^-Ni 

< 2 53 bn+w.l min (l,n|C|) 

< C min (1,|CI) - 
Take 《 arbitrary, with Im ^ > 0. If j^J < 1, then 

n r i( 2 "^) < flll+C2^} 

J=1 J=1 

< n ex p ( 2 - j c) < . 

If jC| > 1, then there exists jo>Q so that 2 J0 S |《| < 2 JO+l , and 

n r “ 2_j 2 會 w 


(6.2.3) 


n r i ( 2' j o 

户 i 


Jo + l 

< n( i+c ) 


M 

wr 


< (1+C) J0+1 e c * 

< e c (1 + C) exp|ln(l + C) In 1^(/In2| 

< (1 + C) 6 C |^|ln(l+C)/ln2 


(6.2.4) 


Combining (6.2,3) for (^| < 1 and (6.2.4) foi |^j > 1 establishes the desired 
polynomial bound. '■ ,， 


r, to define & bona fide 


So far, so good. All this is not sufficient, ho 
scaling function. A counterexample is 

mo(0 = ( 1+ 2 e (1 e~ 2l€ ) 

=i±p ， e^eos|. 

This satisfies (6.1.1), as well as mo(0 ) 二 1. Substituting it into (6.2.2) leads to 5 

姒 )：(2 龙 r 1 〜娜 ? 


or 


0 ( 工） 


I ^ 0<x<3, 
I 0 otherwise. 


This is not a “good” scaling function: the 0o |n (x) = 4^x—n) are not orthonormal, 
even though mo satisfies (6.1.1). Anoth 欧 way of looking at this is to see that 
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(5.1.19) iA not satisfied: ^ 

WC + 2ir0| 2 = (2ir) _1 |i + i C os ^+?cos2^J - 

that this means that + 2 tt,) 卩 = 0 for ^ so that ($.3.2) 

is Hot satisfied: the 如,„ are not even a Riesz basis for the space they span. 6 
4 - Id order to avoid this kind of mishap, we have to impose extra conditions 
on mo to make sure that 洽 generates a true multiresolution analysis. These 
conditions ensure that 

, ,E i^^)l 2 -(2^r)- 1 (6-2.5) 

for all 4- Once (6.2.5) is satisfied, everything else works: the spaced 
Vy = Span{0 Jt n； n € Z} constitute a multiresolution analysis (by §5.3.2); in 
each V Jt the (^j, n )n€Z constitute an orthonormal basis. We define by 

c ^(x) - s/2 0(2x-n);. (6.2.6) 

n 

this is automatically jcompactly supported because 4> is and because only finitdy 
many hn differ from zero. The {^j,k)j,k^Z constitute then an orthonormal basis 
of compactly supported wavelets for L 2 (R). 

Before w6 go into the conditions on mo that ensure (6.2.5), it is interesting 
to remark that even if (6.2.5) is not satisfied, the function ^ defined by (6.2.6) 
still generates a ti^ht frame, as proved in Lawton (1990). 

Proposition 6.2.3. Let mQ be a trigonometric polynomial satisfying (6.1.1) 
and mo(0) = 1, and let iff be the compactly supported L 2 -functions defined by 
(6.2.2), (6.2.6). Define, as usual, xf> jk (x) = 2~“ 2 ^(2~ 3 x - fc). Then, for aU 

f € L 2 (R), ’ 

Et</. ^*>| 2 = II/Il a , 

}MZ 

the (^y,fc； j^k € Z) 6onstitute a tight frame for L a (R). 


Proof. 


1. First remember that (6.1.1) €an also be written as 

^ Kn Kt+2k — ^k,o - ( 6 . 2.7 

m 

(see (5.1.39)). 

% IWce / compactly supported and C°°. Then |{/，^j,*)| 2 convirges for 




fc)l 
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< WfWl !«tpport(/)| V / dx W2*^-fc)| 2 . 

^ </*€w»pport(/) 

< H/lli,|8ttPPort(/)| X ； / dy\<t>{y~k)\ 2 . (6 2 8) 

* J»€3^*upport(/) 


Choose K so that 2^ »upport(/)n[2~ J ^upport(/)+ib] is empty iik>K, 
Then 

E / #l^(y-*)l 2 

tiz • /v€3 ' J *«pp°^(/) 

*EE/ ibmv-rnK-O? 

m€ z iuppertt/) 

K-\ f 

^ XT' I UlY.. _ 州2 




(because, for every £ t the sets 

(2 _J support(/) + t+mK) me z do no* overlap) 

^ < K li^H 3 

變 Similarly, KA 蚝 .0 卩 converges for aU j 
%: Because 4>~Y, n h n^>~i,n, ^ = En (-^)" we have 

* E[K/^.*)! 2 + K/.^.*)l 2 ) 

=[Aw-2ft fhn 2k + (-l) B+，n fc， n+1+a * h-m+l+Ve] 

k m,» 

* (/ » ^-l,n)<^-l,»n. /) • ( 6 . 2 . 9 ) 

It is easy to check that the right-hand side of (6.2.9) is absolutely summable 
(use that only finitely many at« nraizero), po that we may invert the 
order of the summations. . 

4. H n, m are even, » =» 2r, m =» 2a t we have 

53 [^-2* ^2#-2* + ^-ir+ait+l ^-2*+3*+l] 

k 

= 5 ^ ^2r-2fc ^3«~M + 53 ^Jr-2£+l 

fc < 

(substitute k — s + r-£) 

= 53 ^6r f$ ~ 6 n , m (by (6.2.7)). 

p 

Similarly, forn = 2r + 1» m * 2# +1 both odd* 

^2 [^2r+l-2fc Aa#+l-2fc + ^>3r4-3Jk ^-2*+3*] - 石 r ， • 总 备 n，m • 
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5. If n = 2r is even and m = 2s + 1 is odd, then 

^2*+l-2fc ~ h-2r+2k+l ^-2*+2fc] 
k 

= ^2 h2r-2k h 2s +i^2k - ^2 *2#+l-2 / ^2r~24 
k t 

(substitute A: — s +1* — /) 

~ 0*^ 6n,m - * 

6. This establishes 

^ [^n-2* ^m-2k + (-l) n+?n ft —n+l+2fc m+l+2fcj ~ 

k 

for aD m, n. Consequently, 

[[K/ ，0o, fc )l 2 + K/, _>l 2 卜 [K/， ^-l,m)| 2 . 

k m 

By “tel 雄 coping,” we have 

E E k/*^)i 2 = E k/^-m>i 2 -Ek/ ， ^>i 2 . (6.2.10) 

j=-J+l k£Z k k 

7. The same estimates as in points 3 and 4 of the proof of Proposi¬ 
tion 5.3.1 show that, for fixed continuous and compactly supported /, 

l 《 / ， ^J,fe)l 2 < c ^ is large enough, with c arbitrarily small (J de¬ 
pending on / and e). Similarly, the estimate in point 3 of the proof of 
Proposition 5.3.2 leads to 

!</, = 2, y> 喊 2 - 々)| 2 l/(«| 2 + i2, <6.2.11) 

with |i?| < t if J is suffidently large. Since 0 is contiimous at ^ = 0, and 
0(0) = (2ir)~ 1/2 , the first term in thfe right-hand side of (6.2.11) converges 
to fd^ |/(《}卩 for J—oo (by dominated convergence: 1^(01 ^ (2 冗 ) _1 / 2 
for all 《， because |mo| < 1 by (6.1.1)). Combining all thte with (6.2.10), 
we have 

E K/ t ^*)l 2 = ll/ll s 

上 fceZ 



with frame constant L By Propoflition 3.2.1, this frame is an orthonormal basis 
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if and only if |{^{| = 1 (use that |j^j,*|| = ||^|| for all j, ^ e Z) y or equiva- 
lentfy, if f dx ♦(x) i/;(x — A;) ~ ^,o for all e Z. 7 This in turn is equivalent to 
WK + 2 tt^)| 2 = (2tt)~ 1 . Using |^(0I = |moK/2+7r)| |^/2)| (a consequence 
of (6.2.6)), this can be rewritten as 


|moK/2 + tt)| 2 or (i/2) + |mo(e/2)| 2 a(C/2 + ?r) = 1， 


( 6 . 2 . 12 ) 


\ with a(0 = 2ir YLt I^(C + 2tt^)| 2 . This is equlyalmit to t 

I |mo(C)| 2 WC + 龙 ) 一 11 + KCC + x)! 2 [a(0 - i! 二 0 . (6.2.13) 

I We ha 奸 mo(C) = ^ 叫， with h Nl ^0^ so that |mo(OI 2 isa 

^ polynomial in cos ( of degree Na — Ni ，On the other hand, a(C) — ^ oct e_ 成， 
K with oci — (2n)~ 1 J e ,/€ |^tf)| 2 = (2 貫) -1 /血 ^(x) (f>(x - £) = 0 if 
£ > N 2 — Ni t since support ^ C [Nu iV^J- Ckmsequently, a(() - 1 is a poly- 
1 , nomial in cos ( of d^ree N 2 - Nj — 1. However, by (6.2.13), a(C) — 1 is zero 
^ whenever |mo(C)i 2 is (|mo(C)| 2 and jmo(C + w)| 2 have no zeros in common), so 
that this polynomial has at least N 2 — N\ zeros (counting multiplicity). Since it 
si of degree N 2 — N\~ X, it therefore has to vanish identically, i.e,, a(C) 三 1, or 
-|0(C+2ir^)l 2 = (2?r)~ 1 . This is another way to derive that (6.2.5) is necessary 
^«ad sufficient for the 岭 j,jt to constitute an orthonormal baas. 

, In the non-orthonormal example we sttPr shove, with mo(^) — |(1 + e~ 3 *^), 
the recipe (6.2.6) fw tff leads to 


5 » 0 < a: < § » 

^i x ) — < 一 i , § < * < 3 , 

L 0 o^erwise .. 


In this case ^ is indeed not normalized, ||^|( = 3 一 " 3 . If we define ^ = || 岭『V， 
then the normalized, and constltillea tight frame with frame c<»astaiit 

3： the w redund^ncy factor" of the £ram6 is 3. This is not so surprising once 
«>ne realizes that the family ($j,k)j,k€Z can be considered as the union of three 
: shifted copies of a w stretched B Haar basis: _ 

I 、 ^ = Dsi^r t 、 

: fc* + i)(x) = {ihi^r)(x~uz) y 

: (^j,3k+2)(^) - (Dz 私 (: - 2/3) ， 

s with (Z? 3 /}(*) = 3 1/2 /(3x). 

But let us return to the condition (6.2.$), 

^|<?« + 2^)| 2 = (2ir)- 1 , 
i 

Or its equivaknt 

J dx ^(ar) ^(x-n) = 5 n ,o • (6.2.14) 
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Several strategies have teen developed, corresponding to conditions on mo, to 
ensure that (6.2.5) or (6.2.14) hold. Most of these strategies involve proving that 
the truncated functions ft introduced in the proof of Lemma 6.2.1 (or some other 
truncated family) converge to 0 not only pointwise T but also in L 2 (E). Since it 
is not hud to show that, for every fixed k t the {/* (•- n); n € Z} aie orthonor¬ 
mal, this ^-convergence then automatically implies (6,2.14). Conditions on mo 
sufficient to ensure this Z, 2 -converg»ice axe t e.g.» 


or 




withr 


inf (mo(OI > 0 (Mallat (1989)) 


mo(0 = 


(钟 


ao, 


sup |£(^)| < (Daubechies (1988b)) 


(6.2.15) 


(6.2.16) 


Neither of these conditions is necessary, but both cover many interestmg exam¬ 
ples. Better bounds in \C\ than (6.2.16) lead to regularity for and we wilt 
come back to this in Ch^Jter 7. Subsequently，necessary and suSicient conditions 
on mo were found. We discuss these at length in the next secti<m. 


6.3. Necessary and suiiicient conditions for orthonormallty. 

Cohen (1990) identified a first necessary and sufficient condition on mo ensuring 
L 3 -convergence of the /*. Cohen’s condition involves the structure of the zero-set 
of mo. Before starting his result, it is convenient to introduce a new c6ncept. 
Definition. A compact set K is called congruent to (-?r, ir) modulo 2?r if 

1. \K\ = 2tt ； 

2. For all ^ m (—ir, tv], there exutsj € Z so that ^ + 2£ir € K. 

TVpically, such a cornfmct set K congruent to [~ff, ir] can be viewed a& the 
result of some “cut-and-paste-worfc” on [-7T, ir]. An example is pvefi in Figure 
6.1. We are now ready to state and prove Cohen’s theorem. 

Theorem 6.3.1. (Cohen (1990)) Assume that ttiq is a iriganomeinc poly- 
nomittl satisfying (6.1.1), with mo(0) » and define ♦ as in (6.2.2). Then the 
foliowing are equiwdent: 


{6.3.1) 


J dx ^(x) <f(x - n) = 6 nfi . 

l^Then exists a compact setK amgrucnt to (-tt, moduio2v and contain¬ 
ing a neighborhood o/O so that 


iaf igf K (2^)l>0 


(a.3.2) 
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b h 


•3n 


•2n 


_吾 




Fig. 61 K = U *r,-f] U [一 f » 穿 ] U [ 专 ， U [ 年，守 ] « d compact 

Bet congruent to (-■»r, n] modulo 2ir; tt can be viewed as the ixsnU of cttUtng [—ir/2, -tt/ 4] and 
|5w/8,3ir/4} oui of j-ir,ir] and movmg the first pieot to the 6y 2ir, the second io the left 
by 4n t - 


Remark. The condition (6-3.2) may seem a bit techi^al, and hard to 
verify in practice. Remember however that K is compact, and is therefore 
bounded ： K C [—/?, H]. By the c^mtinuity of mo and mo(0) = 1, it follows 
that |mo(2~ fc ^)| > uniformly for |^| < R } if k \s larger than some fco. 
This means that (6.3 2) reduces to requiring that the ko functions mo((/2)i ， 
爪 0( 《 /4) ， ， . ， mo(2^ k °^) have no zero on /iT, or equivalently, that mo has no zero 
m K/2 y /C/4, • • ， 2~ k °K This is already mudi more accessible! a 


Proof of Theorem 6.3.1 t 

1. We start by proving (1) (2). ， 

Assume that (6.3 1) holds, or equivaleatly, 永 《 + 2irt)\ 2 — (2n)~ l . 

Then, for all ^ € f-w, ttJ, there exists 々 € N so that 

E Wl + 2^i 2 >(47r)- 1 . 

Since 表 is continuous, the finite sum 1》(.+ 卩 is continuous 

as well. Therefore there exists, for every C ^ [— 丌，丌 1， & neighborhood 
{C ； |< -^| < R^} so that, for all ( in this neighborhood, 

' E + > ㈣- 1 . 

m<i t 

Since [- 贫 ’ 7r] is compact, there exists a finite subset of the collection of 
intervals {C;|C - ^| < which stIO covers 卜賞，賞 ]. Take 4 to be the 
maximum of the associated to Ui& finite covering. Then, for all C ^ 

[-貫，贯1， 

E 成 C + 2irf)| a 2( 紐疒 1 , (6.3.3) 

m<ib 

2. It li^lows tlmt for every ^ € [- 賞 ， thoe exists £ between and 4 ao 
that |^-f-5ir/)| > [87r(2/b+l)}* 1 ^ a = O. Define now sets Si, — <t<ta 
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[^7T, ttI; !0(O! > C) 

and, for i ^ 0, • 


^ - U € [-7T, 7T]\ ( (J 5 & US-o)； m^^)\ > O 


The 5/, — £o < ^ < to form a partition (rf [-ir, 7rJ. Since 
|0(O)j '= (27r) _I/，2 > C, and since 4> is continuous, Sq contains a neigh- 
borhood of 0. Now define 

,0 __ 

K = |J (5>T2^)- 

<=—<0 


Then K is <;Jearly compact and congruent to [-tt, it] modulo 2n. By con¬ 
struction, > C on K t and K contains a neighborhood of 0. 

3. Next we show that K satisfies (6.3.2). As pointed out in the remark before 

the proof, we only need to check that |mo(2~ fc ^)j > 0 for a finite 

number of k, I < k < k Q . For ^ G K,we have that 

1^)1 = (6-3-4) 

is bounded below away from zero. Since |0| is also bounded, the first factor 
in the right-hand side of (6.3.4) has therefore no zeros on the compact set 
K. As a finite product of continuous functions it is itself continuous, so 
that 

k 0 ' 

J] |m 0 (2-^)| >Ci >0 (or K . 

fc = l 

Since \tuq\ < 1, we therefore have, for any k y l <k < ko y 

ko 

|mo(2- k 0l > > C! >0. 

Jfc^i 

This proves that (6.3.2) is satisfied, and finishes the proof (1) ^ (2). 

4. We now prove the converse, (2) =» (1). 

De£ne n k [i) = (2 冗广 " 2 一 *《)，where \k is the 

indicator function of K, xk(0 = 1 if ^ € K, 0 otherwise. Since K contains 
a neighborhood of 0, pointwise for k~*oo. 
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5. By assumption, |mo( 2 ~^)| > C > (^ for > 1 and ^ € K. On the other 

hand, we also have, for any |mo(C) ~ w»o( 0 )| < hence |m。 ⑹ | > 

1 - Since K is bounded we can find ko so that 2 _fc C / |^| < 5 e /£T 

and k > ko. Using 1 - x > e~ 2x for 0 < x < we find therefore, for 

I 祕 )1 = ㈤ 部 f||mo(2- fc e)l ft |mo(2- fc OI 

fc=l fc=fco+l 

« 00 

> (2n)^ 2 C^ JJ exp [-2C'2- fc |C|l 

A：i=ico+i 

> (2?r)- 1/2 exp ra^c|C|J = > 0 . 

We can rephrase this as 

^ xk(o < mwc ^. 

This implies 

k 

lMfc(e)l = (2ir)- 1/2 U|mo(2- ， e)IXif(2-*C) 

户 1 . 

* 

< (err 1 ㈣ 一 1/2 nK( 2 '^)IW 2 ' fe «l 

j=i 

= (cn— (^r 1/2 \ko\ - ( 6 . 3 . 5 ) 

We can therefore apply the dominated ctmvei^ence theorem and conclude 
that in L 2 . 

6. The congruence of K with [-ir, it] modulo 2?r means that for any 
27r-periodic function /, J^ K d^ f(0 = f % 氓 m = O /(«. In 
particular, 


dC l^(OI 2 - (2nr X ^ / 战成 S 1 叫的 )| 2 


•2ir 


Jfc- 

dC 

/=0 

(2ir)~ 1 2 fc jf dCe-^ |j| 的 )| 2 

㈣ ]2* Jpf |mo(^C)| 2 

{^r l 2 k r<Ke- in2h < if Imof^C)! 3 


K(C)| 2 
[|mo(C)| 2 + |mo(C + ^)| 2 ] 


/ =1 
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: -2 


(2ny 1 2 k ~ l / di e' in2fc J] 


/*o 


处 ⑹ |K 


.Since 


(2 尔 12 乂成 


jd( |mi («| 2 e in€ = 
this implies / e ~ tn ^ 

y^e l^)t 2 e - 叫 = fc iim I t^(C)l 2 e - 叫 


- 3mC -^,o, 
6 n ,o for all k. Hence 


(because pointwise, together with 

the dominance (6.3.5)) 

— 石 n,0 ， 

which is equivalent with (6.2.5) and therefore with (6.3.1). • 

Remark The truncated** functions ^ are not the same as the ft in¬ 
troduced in the proof of Lemma 6.2.1, but the following argument shows that 
JL 2 -convergence of the ^ implies /^-convergence of the /*：. First of all, K 
contains a neighborhood of 0, AT D [—a, a] for some a, 0 <’ a < 貫 . De¬ 
fine p k - ( 加卜/ 2 nj =1 mo(2D x 【 - a ， aK2 -A ^) ‘ Since xi-a,a] < XK, the 
same dominated convergence argument as for the ^ applies, and 外 一 ^ in 
L 2 . Consequently, \\^ k — for k—oo. Using the congruence of K 

to [-tt.tt] modulo 2n, one shows that n|U 2 = ll/fc — v k\\L 3 - Hence 

II/* - 4>\\l^ ^ ll/fc - + \Wk - k~KX>. □ 

Note that if Mallafs condition (6.2.15) is satisfied，then we can simply take 
K = [-ir, 7r]; Cohen’s condition is then trivially satisfied, and the are 
indeed ortbonormal. The following corollary gives another example of how to 
apply Cohen’s condition. 

Corollary 6.3.2. (Cohen (1990)) Assume that toq ts a trigonometric poly¬ 
nomial satisfying (6.1.1), with mo{0) = 1, and define <f> as is (6.2.2). If mo has 
no zeros in [~w/3, ir/$], then the 知 ， n are orthonormal. 

Proof. We need only to construct a satisfactory compact set K. Since mo 
may have zeros in ir/3 < |^j < k/% K = [-7r, n] is no longer a good choice. 
But we can start with this dioice as an ansatz, and “cut out” the zeros. More 
precisely, assume that the zeros mo in 霄 /3 < ^ < w/2 are ^ < 4^ + - 

(They are necessarily finite in number, mnce mo is a trigonometric polynomial.) 
Similarly, we have< * * S ^ ^ zeros of mo in —tt/2 <(< -ir/3. For 
every i choose to be the intersection with [-ir, tr] of a small open im^val 
* small enough so that tSue it 4o overtop with each other 议 with 
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A very different 叩 proacli to the derivation of conditions on mo that ensure 
(6.2.5) was initiated by Lawton (1990). Let us assume that mo is of the form 


moiO 


述 V 气 


(6.3.7) 


i,e., h n = 0 for n < 0 or « > N; can always be brought into this form 
by multiplication by e tNl ^, corresponding to a shift of 0 by Nj. Define 〜= 
/ dx <l>[x - l). Since support(0) C [0, N], = 0 if |^| > JV, and we 

can regroup the non-trivial a/, \i\ < N into a (2N - l)-dimensional vector 
(Q_jv + i,---,Q a ,- *,aN^i). Because 冶 (i) = \/2 <^(2x - n), the a t 

satisfy 


at 


2 ^ h n I dx 4>{2x - n) ^{2x ~2e^m) 

n ， m=0 J 

N 

~ 》 : n 

«，•=() 

N-l / N __\ 

- - 51 I h k ^2e+n j <Xk 

一 N +1 \n=^Q / 

If follows that if we define the (2N - 1) x (2N - l) matrix A by 
Aik = ^*-2/+n » < l,k < N - \, 


n=0 


where implicitly h T 


0 if m < 0 or m > TV, then 


(6.3.8) 


(6.3.9) 


(6.3.10) 


i.e” a is an eigenvector of A with eigenvalue 1. Note that 1 is always an eigenvalue 
of A: if we define 0 by 3 = (0, … ， 0 t 1 ， 0,… ， 0) {1 in the central position), or 
Pt~ ^,o» then 

(A(3)t - ^ A tk 4,0 = y^^tn h n -2t = ^,o = 0t 


by (6.2.7), i.e., A0 — /3. If the eigenvalue 1 erf i4 is nondegenerate, then a 
necessari^r has to be a multiple of /?, i.e., J dx 4>{x) ^(x ~t) = 7 办 , 0 for some 
7 G C. This implies 1^(^ + 27 tA)| 2 = (27r)* 1 7 ； since |^(27Tfc)| — 0 for fc ^ 0 
(see the start of § 6 . 2 ) ahd <^(0) — ( 2 ff )~^ 2 by definition, it Follows that 7 = 1 , 
so that J dx (f>(x) <j>(x — t) — 6 /, 0 . We have thus a very simple sufficient criterion 
for orthonormatijty of the 0 o, n * 

Theorem 6.3.4. (Lawton (1990)) Assume that mo is o trigonometric poly¬ 
nomial of the form (6.3.7), satisfying (6.1.1) and mo(0) = 1; define ♦ as tn 
(6.2.2). If the eigenvalue 1 of the {2N - 1) x (2N - 1) matrix A defined by 
(6.3.9) is nondegenerate, then the <j>Q tn are orthonormal. 
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Orthonormality of the 如 , „ can only fail if the characteristic equation for 
A has a multiple zero at 1. This indicates that among all the possible choices 
for the kn t n ^ 0, • •, iV (keep N fixed), the “bad” choices (leading to non- 
ortbonormal 如 ， n ) constitute a very ‘*thin” set. (This statemrat is made more 
precise in Lawton (1990).) For iV — 3, for instance } the only non-orthonormal 
choice (up to an overall phase factor) is ho = 1/2^ hi ~ As ~0, 

Lawton’s condition can be recast in terms of trigonometric polynomials. De¬ 
fine, as before, M 0 “) = |mo(OP, and define the following operator Po t acting 
on 27r-periodic functions /. 


(P 0 /)<《） = M 0 {i/2) /( 《 /2) + M 0 (《/2 + rr) / ⑹ 2 + r). 


Clearly the constwt polynomial 1 is invariant under Po by (6,1.1). Toting . 
everything out in terms of Fourier coefficients, we have " 








AfoK) f(0 « f(~k J ； 


k,n 


(Pof)t 


(Pof)iO -E (Z 

t \fe,n / 

k t n m \ n / 


This is essentially the same expression as (6.3.8)! (We have not assumed that 
/ m — 0 for }m| > N, however, so it is not quite the same*) k follow that Law¬ 
ton's condition is satisfied if we know that the only trifonometric polynomials 
invariant under Po are the constants. 

A priori it is not clear whether Lawton’s condition is sufficient or not: it is 
conceivable that A has an eigenvector difoent from 0 with eigenvalue but 
that a nev^theless happens to be equal to However, in the spring of IdW 
both Cohen and Lawton proved, indep^Kiently, that their two conditions are 
equivalent (& goieralizstioiukppeaiB In Co|m, Daubecbies, and Fhauyeau (X992) 
as Theorem 4.3; see also Lawton (1991)), implying the sufficiency of Lawton's 
condition. 


THEOREM 6.3.5, Assunie that is a trigonometric polynomial such that, 
(6,1.1) i« satisfied and md(0) — If then exists a amipact set K congruent 
n] modulo 2rr # containing a neighborhood of0 t such that inf^i inf^^K 
r*^)| > 0, then the only trigonometric polifnormaU under are 
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I Remark. This is sufficient to prove equivalence. If we denote Lawtcm^s orig- 
| inal condition by ⑹， Cohen’s condition by (C) f Lawton’s condition rephrased 
I m ^erms M by (/ ^ and the orthonormallty of the 如 , n by (O), then we already 

know 

fp) (i) ^ (O) ^ (C) . 

The implication (C) (P) suffices to prove equivalence of all four conditions, o 



Proof of Theorem 6.3,5. 


1. We will prove that the existence of a noncoustant trigonometric polynomial 

/ invariant for P 0 contradicts the existence of a compact set K with all 
the desired properties. Suppose / is such a aonconstant trigonometric 
polynomial, invariant for Pq. Define /i(C) = /(《） 一 min <； /(C), = 

—/(0 + naax^ f(Q. Since / is not constant, at least one of / lt / 2 has 
fj(Q) ^ 0. Pick j so that /， ⑼〆0, and define / 0 - f y Then /o is 
nonnegative, /o(0) ^ 0, /o has at least one zero’ anct /o is invariant under 
Po- 

2. Next we explore the zero set of /©, which turns out to have a very particular 
structure. If / 0 ⑹ = 0 for 0 # ^ 6 [0, 2 tt(, then 

o- Sod) = (Pohm = Mo(m Mi/2) + M 0 (《/2 + TT) / 0 (《/2 + IT). 



Here Mo, fo are both nonnegative, and A/ 0 ( 《 /2) f M 0 (^/2+w) cannot vanish 
simultaneously, by ( 6 . 1 . 1 ). Therefore, either / 0 (^/ 2 ) or /o (《/2 -f tt) = 0. 
It follows that if we-pick one zero 0 /€ [ 0 , 2 ^( of /o, then we can 
associate to it a chain of zeros in [ 0 , 2tt[, ( 2 , … ， C*， …， with the property 
that 6+1 equals either ^ or ^ + jr, or, equivalently, ^ — r$ i+1 , where 
r is the transformation | 2 ^ mod ( 2 ir), which maps [ 0 , 2 tt[ into itself. 

Being a trigonometric polynomial, /o has only finitely many zeros, so that 
this chain cannot go on ad infinitum. Note that the chain has at least two 
elements ， since 二《1 would imply 《1 = 0. Let r be the first index for 
which recurrence occurs, i.e” 心 =for some k < r. Then necessarily 
fc = 1 , because * > 1 would lead to ^1 — — — ( r 一 with 

l<r — Ar+l<r，so that r would not be the first index for recurrence. 
It follows that we have a cycle of zeros, 心 ,…, Cr_i，with for 

); 1，…， r - 2, and = ^ 1 . Note that for every zero in 

this cycle. 

3. If this cycle of zeros does not exhaust the set of zeros different from 0, 
then we can find 0 ^ Ci ^ 3 = X, - • • ,r - 1 , for which /o(Ci) ― 0 . 

This can again be taken as a seed for a diain of zeros, < 1， Ca， …，。 ，…. 
Every of this new <^iain is necessarily different from all the ^ 

aiiM^ would imply 6 53 i.e., Ci would equal some 

匕 By the saxne argument as above, gencratei theref<ve a ^deof xmse 
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for /， invariant under r, and disjoint from the first cycle. We can keep 
on constructing such cycles until exhaustion of the finite set of zeros of /o. 
The zero set of / 0 therefore {insists of a union of finite invariant cycles 
for r. 

4. Now note that if /o(() = 0, then necessarily / 0 (《+ ir) ^ 0. Indeed, since 

= t(( + 7r), both ^ and 《 + would belong to the same cycle of zeros if 
/o(C) = 0 = /o(C + tt)- If this cycle has length n, then it would follow that 
^ — T n 《= - : + 7r) = ^ -f 7r, which is impossible. 

5. Finally, we remark that if /o(《）= 0, then Mo(( + jt) = 0. Indeed, for any 
(so that fo{0 = 0, is also a zero for /o, and it follows that 

0 = fo(ri) = (Pq/)(tO - M 0 (0 f(() + Mo(^ + ir) m + n). 

Since /o(0 = 0 and /o(( + ?r) ^ 0, this implies M 0 (《-f 7r) = 0; hence 
m 0 (^ + 7r) - 0. Therefore, the existence of / 0 implies the existence of a 
cyclic set (i,for t ，with - r 心 +1 ， j = 1, …， n - 1, 心 =r^ n , so 
that m 0 (《j +it) — 0 for all j. Since /o(0) / 0, we have_ 0. 

6 . We now show how these zeros + ir for mo are incompatible with the 
existence of K. Since t《 j+ i =r^ n — 《 j, and, in particular, ^ = 
r n ^ 3 , we have ^ = 27rx Jf where the x 3 e [0,1( have the following binary 
representations: 

/ 

x\ — ,d\d 2 • * - dnd\ - * - dndi = 0 or 1) 

X2 — .th … dndi - - - dndi * • d n - • 

怎 n = -dndi - - - dnd\ … dn … 

Since ^ 0, not the dj are zero. Let us, for this point only, define 
rf = 1 - for d = 0 or 1, Then ^ +tt = 2ny 3 modulo 2 tt, with y 3 given by 

Vi = .did^ds - - - d n di - - - d n d\ …… 

V2 = .<#2^3 - ■ * 屯 山… dndi … d n … 

Vn = -dndi - dndi … d„ … 

We have mo(2^) = 0, / = 1,- -.n. Suppose a compact set K existed 
with all the desired properties. Then there would be an integer t, with a 
binary expansion with at most a certain preassigned number L of di^ts (L 
depends only on the size of K\ so that 2iry = 27r(2yi +€) has the property 
that mo(2ir2~ k y) ^ 0 for all > 0. We have 

y = et • • • C2^i -^2^3 - * • d n d\ - - - dndi. •. dn • ‘ • ， 
with Cj = 1 or 0 for j = 1， . * • ， Zr. We can also rewrite this as 

y — €i,+n *' • ^L+l e L * * * e 2 ^l *^2^3 - - - dndi • • - d„di … dn …， 
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where e 3 = 1 or 0 for j = 1， •. ， L and = 0 if j > L. The 2~ k y are 
obtained by shifting the decimal point to the left. Since mo is 27r-periodic, 
only the “tail,” i.e” the part of the expansion of 2~ k y to the right of the 
decimal point, decides whether mo(2ir2 _fc y) vanishes or not. If = dj, 
then y/2 would have the same decimal part as y\, hence mo(27rj//2) — 0 
would follow. Since mQ{2ny/2) ^ 0, we therefore have e\ — d\. Similarly, 
we conclude e 2 — d n , ― d n _i, etc. It follows that e i+ i, • - ■ ,ei +n 
are also successively equal to -• • .di.dn* *»<4 +1 for some k € 

{1,2,.. * ,n}. Since the d 3 are not all equal to 0 ， whereas e^+i == • •，= 
CL+n = 0, this is a ajntradictioU ； This finishes the proof. • 

With Theorem 6.3.5 we end our discussion of necessary and sufficient con¬ 
ditions on ma- The following theorem summarizes the main results of §§6.2 
and 6.3. 

Theorem 6.3.6. Suppose mo is a tngonometnc polynomial such that 
Ko(C)| 2 + Jmo(^ + 7r)| 2 - 1 and m 0 (0) = 1. Define 4> f by 

kO - (^r i/2 n mod ) ， 

7=1 

= -e- 14/2 mo (^72 + 7r) 4>U/2 ). 

Then <{>， 分 are compactly support&i L 2 -functions, satisfying 
^(x) = v/2 Y, h n4>{2x-n), 

n 

蛉 ⑷ =^53(-1)" A-„+i ${2x - n), 

n 

where h n w determined by mo via mo(0 ~ ^ 吃 Moreover，the 

— 2”/ 2 ip(2~ 3 x - k), j,k e Z constitute a tight frame for L 2 (R) with 
frame constant 1. This tight frame w an orihonormal basts if and only %f mo 
satisfies one of the following equivalent conditions: 

• There exists a contact set K, congruent to [—7r, tt] modulo 2n, containing 
a neighborhood of 0 # so that 

gf mf |mo(2- fc O|>0 . 

• There exists no nontrivial cycle Ki, • • *» [0,27 t[, invariant under r: 

态卜 ♦ modulo 27t, such that mo(^j + 7r) = 0 for allj = l, - n. 

• The eigenvalue l of the [2{iV 2 - Ni) - 1) x { 2 (iV 3 - Ni) — l]-dimen8ional 
mc^rix A defined by 

'fh 

4= X] + ( 沁 _M) + 1 

(where we assume h n for n < N it n > N 2 ) is nondegenerate. 
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FVom the point of view of subband filtering, this theorem tells us that, pro¬ 
vided the high-pass filter has a null at DC (mo(7r) =? 0 t hence m 0 (0) = 1 with the 
appropriate phase choice), we “almost always” have a corresponding orthonor¬ 
mal wavelet basis. The coTrespondence only fails “accidentally,” as is illustrated 
by the last two equivalent necessary and sufficient conditions. In practice, one 
likes to work with filter pairs in which the low-pasa filter has no zeros in the 
band | 豸 | < 7r/2, which is sufficient to ensure that the ^,/t are an orthonormal 
basis. But it is time to look at some examples! 

6.4. Examples of compactly supported wavelets generating an 
orthonormal basis. 

All the examples we give in this section are obtained by spiral factoriasaticm of 
(6.1.11), with different choices of N and R. Except for the Haar basis, we have 
no closed-form formula for 0(x), wejvill explain^ia the next section how 
the plots forj6, ohtaiq e^. 一 

** A first family of examples, coastructed in Daubechies (1988b), corresponds 
to H ^ 0 in (6,1 11). In the spectral factorization needed to extract £(《）from 
L{^) — (sin 2 《 /2), we retain systematically the zerc» within the unit circle. 
For each N, the corresponding j^mo has 2N non-vanishing coefficients; we can 
choose the phase of nttiq so that 


- 2JV-1 

wmo(0 = 53 Nhn 叫 . 

n*0 

Table 6.1 lists the for iV = 2 through 10. For faster implementation, 
it makes sense to keep the factorization (6.1.10) explicit: the filter C is much 
shorter than xn^ (N taps instead of 2iV), and the filters 1 ■ 士 ! are very easy to 
implement. Table 6.2 lists the coefficientsr of £(^), for iV = 2 to 10. Figure 6.3 
shows the plots of the correq>ondmg jv0, jvV> for ^ ~ 2,3,5,7, and 9. Both 
jv 沴 and have support width 2N - 1; their regularity dearly increases with. 

N, In fact, one can prove (see Otapter 7) that for large N 
with /x ~ .2. 

Retaining systematically the zeros within the unit circle in the spectral fac¬ 
torization procedure amounts to choosing the >( minimum phase filter” mo among 
all the possibilities once |mo| 2 ts fixed. Hiis corresponds to a very marked asym¬ 
metry in 0 and 矽 ， as illustrated by Figure 6.3. Other choices may lead to 
less asymmetric 0 ，矽， although, as we will see in detail in Chapter 8, complete 
symmetry for 沴’妒 can not be achieved (except by the Haar basis) within the 
framework of compactly supported orthonormal wavelet bases. Table 6.3 lists 
the h n for the “least asymmetric” 分，也 for iV = 3 through 9, corresponding to 
the same jmo| 2 as in Table 6.1，with a different “square root” mo. We will come 
back In Chapter 8 on how this “least asymmetric square root” is determined. 
Figure 6.4 shows the corresponding and ^ functions. 

Figure 6.5 shows plots of |mo| as functions of ^ for the above examples, 
for iV = 2, 6, and 10. These plots show that the subband filters for these 
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Table 61 

ITht filter eotffictenta j^hn (low-paas fitter) far the compacUp supported waveleti 
j^uue and h*ghe»t number of vanishing momenta comptttdUe with thetr $uppo 
^hn ore nom^oived so that = V5 



n 

Nhn 

JV»2 1 

0 

4S29629131445341 


1 

*365163037378077 


2 

2241438680420134 

. 

3 

- 1294095225512003 


0 

3326705529500S2& 


1 

806891 S093U0d24 


2 

4596775021184&14 


3 

- iaS0110300102546 
一 085441^738820367 
03622629188 & 7095 


4 


5 

N 亡 4 

0 

2303778133068964 


I 

714S46S705 & 29154 


1 

3 

^30880767938*^7 
- 027983769416859^ 


4 

5 

6 

- 187034SU719093I 
03084138 1835560T 
0328S30116668652 


7 

- 010597401785069& 


0 

1601023979741929 


1 

603829269797189& 


2 

7243085284377726 

13M2BM59013203 


3 


4 

6 

- 2422948870663^23 

- 03^244869$S463ftl 


6 

07757149384004 沾 


7 

a 

- 0067*1 H9021279S3 
- D12S8075I999(»20 


9 

0033J572S2g54738 

Af = 6 

0 

1 

iMM074aa50ibas 

4946238903964533 


2 

7511339080210959 


3 

31525035170919S2 


4 

— 22626469396S4400 


5 

• 1297668b7&672625 


6 

097501 6D55873225 
0275228655303053 


7 


S 

一 0315S2ai9317486? 


0 

OOO55384220U6H 
0047772575 10&455 
- 00107730108& 3(B5 


10 

11 

N = 7 

G 

0778520540850037 


1 

396S393\94»1^1 


2 

729132Q90646I9S7 


3 

.4697«22ST405I8g9 


4 

- H390600392852t2 


5 

- 224036lB4^mi2 


6 

7 

0713092J926682T2 
0806126091510774 


8 

9 

10 

- 0360390399350104 

- 0165745416306^5 
0l26S0&dSSS6O9»6 


11 

•0004 姐 5 打 9729«4 


32 

- 0Q18Dt 6407010473 



.imi537!37W9r4S 




0M41584^2431073 

3128715900143166 
675630736297319S 
S8&3&468365421S8 
0158391052563823 
- 撕 01 吣 4 撕 1 如 4 
0004724845739134 
1387474366204883 
.0173693010018000 
0440882S39307971 
^)139810279174001 
•0087460940474065 
• JD048703529934 &30 
00038t 7403733770 
00067S4494064506 
0001174767841248 


N =9 


0380T79473638778 
3438346746125SSS 
604B211236900955 
6572880780512736 
1331973858249883 
2932737832791663 
O96M0T83222W92 
i48S40?493381256 
«3072$6S]4T93385 
067632839O613279 
UO025Q&4T1148340 
022361662123679B 
iXM7232047 & 7751» 
004281S036824635 
0018476468830563 
00029038»7635232 
0002S196318«8437 
J0000393473303163 


A/ciO 


0266700&79006473 
1S81768000776347 
527201IM9315757 
l>SS4590394S34363 
2811723436605715 
24984M243271S96 
199M627-43772M2 
tlT36834033S75« 
0930573646035547 
.07I394U716«3MJ1 
• 0*94*753682183» 
0332126740593612 
0036065&35669870 
0107331754833007 
00136535174^)688 
0019B3405295192S 
■ (W06g&g5€6»48 & 64 
t66855J286 
5703202 
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Table 6.2 

The coefficients i n of y/f £(f) = t n e~ tn ^, for N ~2 to 10. Normaltzatton ： i n = v^- 


1.93185165258 
- 0.517636090205 


N ^3, 

2.6613644236 

-1.52896119631 

0.281810335086 

N =i 

3.68604501294 

-3.30663492292 

1.20436190091 

-0.169558428561 

= 5 

5.12327673517 

I* 

- 6.59384704236 

1 

3.4i434077007 


-0.936300109646 

1 

0.106743209135 

N = 6 

7.13860757441 


- 11.1757164609 


8.04775526289 


-3.24691364198 


O.TI9428097459 J 


— 0.068947269459T 

N = 7 

9.9650629228ft 

■ 

一 18.9984075665 


17.0514392132 


- 9.03858510919 


2.93696631047 


- 0.547537574895 


0.045275366396T 

iV 

13.9304556H2 


-31.3485176398 

33.6968524121 

- 22.07104076339 

.38930245651 

-2.56627196249 

0.413507501939 

- 0.0300740567359 


= 9 19.4959090503 

-50.6198280511 
63.3951659783 
一 4^.3675482281 
25.8600363319 
-9.24491588775 
2.18556614566 
-0 310317604756 
0.0201458280019 
-10 27.3101 392901~~ 

一 80.408349622 
—' U4.98124563 
- 103.6713817^2 
. 64.3509475067 

^28.2911921431 
8.74937688138 
- 182464995075 1 
0.231660236047 
-0.013582543764 
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1.51 1 2 



FlO. 6.4. Plots of the scaling function 4> and the wavelet for the U teeut 
oompaetly tupporUd waveUts with maztmtim nuniAer of vanitfung moments, for N *= 4,6,8, 
and 10. 


mo(7x/») 5 = 
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orthonormal bases are indeed very Bat at 0 and tt, but very “round” in the 
transition region, near v/2. The filters can be made “steeper** in this transition 
region by a judicious choice of R in (6.1.1). Figure 6.6 shows the plot of |mo| 
corresponding to JV = 2 and H of degree 3 chosen such that |mo(Oi 2 has a zero 
’ at 《 = 7tt/9 (— 140°). This is much closer to & “realistic” subb&nd coding filter. 
The corresponding “least asymmetric” function ^ is shown in Figure 6.7; it is 
less smooth than 4 <f> (which has the same support width, but corresponds to 
N — 4 and R — 0), but turns out to be smoother than 2 <P (for which mo has a 
zero of the same multiplicity, i.e., 2, at 《 = 7r). In Chapter 7 we will come back 

* in greater detail to these regularity and flatness issues. The h n corresponding fco 

* Figure 6*7 are listed in Table 64 .、 




I Fig. 6.7. The "least asy^nmetnc" scaling function ^ and wavelet ♦ eomspondin§ to |mof 

I id# plotted in F^ure 6.6. 

I — . 

All these examples correspond to real /»n» 沴 and 蟥， i.e.，to | 利 and |^>| symmet- 
ric around 《 = 0. It is also possible to construct (complex) examples with |^|, |^| 
concentrated much more on 《 > 0 than on ^ < 0. Take for instance the mo of the 
previous example, which satisfies mo(±^) = 1, and define ( 《 )=mo ( 《 - 夸 ). 

I This obviously satisfies (6.1.1), since mo does, and (0) = X. We can there- 

: ^ construct 妒⑹二 饥 ? (2 一，《 , ㈣) =e_ ⑽ 咖 /2 + 贫 )__.、 
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Table 6.4 

The coefficients for the tow-pass filter rxnresponding to the scaling ^function in Figure 6.7. 


n 

h n 

0 

-0.0802861503271 

1 

-0.0243085969067 

2 

0.362806341592 

3 

0.550576616156 

4 

0.229036357075 

5 

-0.0644368523122 

6 

-0.0115565483406 

7 

0.0381688330633 


these are compactly supported L 2 -functions, and the j,k ^ Z constitute 
a tight frame for L 2 (R), by Proposition 6.2.3. Moreover, since the only zeros 
of mo^ on [-^,7r] are in ( = ±^ t 士 tt, it follows that = 0 only for 

^ = ±tt, or Consequently, > C > 0 for |^| < and the 

constitute an orthonormal wavH('t, basis, by Corollary 6.3.2. Figure 6.8 plots 
Ini* (01, aiul |4#(()|; it in clear that / 0 °° | 彳 # (《)| 2 is much larger than 

f 二 狀 I 彳 # (0I 2 . Not.o that the negative frequency, part of is much closer to 
the origin than the positive frequency part, as required by the necessary condition 
/ 0 °° 成 1(1 — = /° ⑺屯 1(1 MV^tOi 2 (see §3.4). The existence of such 
“asymmetric” j was first pointed out in Cohen (1990); in fact, for any f > 0 one 
can find an orthonormal wavelet basis such that jt/»(^)| 2 < f. 

6.5. The cascade algorithm: The link with subdivision or refinement 
schemes. 

It can already be suspected from the figures in §6.4 that there is no closed' 
form analytic formula for the compactly supported ip(x) constructs here 
(except for the Haar case). Nevertheless, we can, if <f> is continuous, compute 
<f>(x) with arbitrarily high precision for any given x; we also have a fast algorithm 
to compute the plot of <f>. 8 Let us see how this works. 

First of all, since <p has compact support, and 0 € L^R) with f dx <f>{x) — 1, 
we have 

Proposition 6.5.1. If f is a continuous function on R, then，for all x eR, 
lim 2 j f dy y) <f>{2iy) - f{x) . (6.5.1) 

If f is uniformly continuous, then this pointwise convergence, is uniform as 
well. IfJ is Holder continuous with exponent a, 


\f(x)~f(y)\<C\x-y\ a , 




trated more on positive than on negative frequencies 


then the convergence is exponentially fast tn j ’ 

1 /( 2 -) - 2 3 J dy f{x + y) 4>{Vy)\ < (6 5 2 ) 

Proof. All the assertions follow from the fact that 2 3 <f>{2 3 ) is an '"approximate 
谷 -function” as j tends to oo More precisely, 


f ⑷ - 2 J J dy f(x + y) 4>(Vy) 

= J dy I/(x) - f{x + y)] 0(2Jy)| 
=J dz IfM - f( x + 2 - ^)] ^(z) 
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^ MU* : sup j/(x) - f{x + «)( 
t«|<2->ft - 

(where we suppose support 4> C . 

If / is continuous, then this can be made arbitrarily small by cfaoomng j suf¬ 
ficiently large. If / is uniformly continuous, then the choice of j can be made 
independently of and -the conwrgence 4s uniform. If / is Holder continuous, 
then (6.5.2) follows immediately as well. ■ 

A^ume now that 沴 itself is continuous, or even H^der oontiiftious with exponent 
a. (We will see many techniques to compute the Holder @e(>onent of^in the next 
chapter.) Take ar to be any dj^dic rational, x = 2~ J K. Then Proporation 6.5.1 
tells us that 

0(x) = lim 2 J f dy <i>{2~ J K + y) ^(2>y) 

J—OO J 

- \ym^2 j/2 Jdz 4>(z) 

^ lira W 2 ( 也 ^ v -j k ). 

Moreover, for j larger than some 允 ’ 

1^(5-%) - < C2^° , (6.5.3) 

where C, jo are dependent on J or K. If 2^~ J K is integer, which is automatically 
true if j > J, then the inner products 令 _j 、 2 t- J K) are easy to compute. Under 
the 棚 umption that the, are orthononnal (which can be checked with any 
of the necessary and sufficient conditions on mo listed in Theorem 6.3.5) t 0 is 
the unique function / diaracterized by 

(/» ^0,n) = t (6.5.4) 

{f 、 ^j,k) = o for i > 0, A € Z . (6.5.5) 

\ • 

We can use this as input for the reconstruction algorithm of the aubband filter¬ 
ing assGfdsted with mo (see §5.6). More specifically, we start with a low pass 
sequence c° = 知 ， n and a highpass sequence d® = 0, and we "crank the machine” 
to obtain 

c n 1 : hn- 2 k c® . (6.5.6) 

fc 

We then use d~ x =0, to obtain, after another cranking, 

4> 

Cm 2 =53 ^m-2n C^ 1 , (6.5.7) 

n 

etc. At every stage, the ^ are equal to Together with (6.5.3), 

this means that we have an algorithm with exponentially fast convei^ence to 
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compute the values of 0 at dyadic nAkmafe. We can interpolate these val¬ 
ues and thus obtain a sequence 知 actions approximating We can, for 
instance, d^ne i?J(z) to be the function, piecevirise constant on the intervals 
[nr* - 1/2), 2^(n +1/2)(, n € Z r such th«t 喊 (2 - 外 ）= 2" 2 ( 也 0_ iffc ). An¬ 
other possible choice is tjj (a:), piecewise linear on the [2~ J n,2~ J (n + 1)],» € Z, 

so that t,)(2^fc) = fc >. 

For both choices we have the foUcmiag pnoposition. 

Proposition 6.5.2. If 令 is Holder continuous with exponent a, then there 
exists 0> 0 and jo € N 50 that, for j > jo t 

U~ , U- ^-IU« < C7r ai . (6.5.8) 

Proof. Take any a: € R. For any j, choose n so that 2~ J n < x < 
2~ 3 (n + 1)- By the definition of ijfJ, is necessarily a convex linear com¬ 
bination of 2 3f2 {^, 0_/,n) and 2" 2 {0 ， 沴 — 太 „ +1 >, whether e = 0 or 1. On the other 
hand, if j ^ larger than some j 0 , 

f I 則 -2" 2 (“ 十 >| 

< \m~ 0(2^n)| + 2^ J (0,^, n >| 

<C\x- 2~ J n| a + C2~ ja < C 2~ ia ; • 


the same is true if we replace n by n +1. It follows that a amilar estimate holds 
for any convex combination, or |^(x) — < C 2~- ,a . Here C can be chosen 

independently of x, so that (6.5.8) follows. ■ , 

This then is our fast algorithm to compute a{^>roximate values of <^(x) with 
arbitrarily high precision: - 

R Start with the sequence ... 0*.. 010 • • - 0 …， representing the fjJ(n), n G Z. 

2, Compute the rjj (2 _J n), n 6 Z, by “cranking the machine” as in (6.5.7). 
At every step of this cascade, twice as n&any values are computed: values 
at “even points” 2~ j (2k) are refined from the precious step, * 




(6.5.9) 


and values at the “odd points" 2^(2ls+l) are imputed for the first time, 
^(2 - >(2A: + 1))* (“2— 々 ). ' (6.5.10) 


Both (6.5.9) and (6.5.10) can be viewed as convolutions. 

3. Interpolate the ^(2 -J n) (piecewise constant if 6 = 0» piecewise linear if 
€ = 1) to obtain rjj(x) for non-dyadic x. 
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The whole algorithm was called the cascade algorithm in Daubechies and 
Lagarias (1991J, where c = 1 was chosen; in Daubechies (1 册 8b), the choice 
c = 0 was made. 10 All the plots of 沴，沴 in §6.4 and in later chapters are, in 
fact, plots of , with j = 7 or 8; at the resolution of these figures, the difference 
between <f> and these is imperceptible. A particularly attractive feature of the 
cascade algorithm is that it allows one to “zoom in” on particular features of <f>. 
Suppose we already have computed ail the r^(2 -5 n)，but we would like to look 
at a blowup, with much better resolution, of <p in the mterval [|| } centered 
around 1. We could do this by computing all the rjj(2~ J n) for very large J, 
and then plotting r}j(x) only on the small interval of interest, corresponding to 
2 J ~ 4 • 15 < n < 2 J ~ 4 - 17 But we do not need to: by the “local” nature of 
(6.5.9), (6.5.10) much fewer computations suffice. Suppose /i n — 0 for n < 0, 
n > 3. The computation of r) t J (2~ J n) only involves those for 

which (n — 3)/2 < k < n/2. Computation of these, jn itmi, involves only 
the 的一 2(2 -J+2 f) with (fc — 3)/2 < £ < k/2, or n/4 - 3/2 - 3/4 < £ < n/4. 
Working back to j = J - 4, we see that to compute rjg on [j|, we only 
need the "|(2— 5 m) for 28 < m < 34. We can therefore start the cascade from 
••■0-- 010 • • 0 • ■ go five steps, select the seven values r^(2 _5 m)，28 < m < 34, 
use only these as the input for a new cascade, with four steps, and end up with a 
graph of rjg on [||, ||]. For larger blowups on even smaller intervals, we simply 
repeat the process; the blowup graphs in Chapter 7 have all been computed in 
this way. 11 

The arguments leading to the cascade algorithm have implicitly used the 
orthonormality of the 私 or equivalently (see §6.2, 6.3), of the 0o， n : we have 
characterized <f> as the unique function / satisfying (6.5.4), (6.5.5). The cascade 
algorithm can also be viewed differently, without emphasizing orthonormality at; 
all, as a> special case of a stationary subdivision or refinement scheme. 

Refinement schemes are used in computer graphics to d 明 ign smooth curves 
or surfaces going through or passing near a discrete, often rather sparse, set of 
points. An excellent review is Cavaretta, Dahmen, and Micchelli (1991). ^ We 
will restrict ourselves, in this short discussion, to one-dimensional subdivision 
schemes. 12 Suppose that we want a curve y = f(x) taking on the preassigned 
values f(n) = f n . One possibility is simply to construct the piecewise linear 
graph through the points (n, /„); this graph has the peculiarity that, for all n, 

/(¥)= 蠢 / 士 ) + ^/( 以 1 )， (6-5.11) 

which gives a quick way to compute / at ludf-integer points. The values of / at 
quarter-integer points can be computed similarly ， 

. + = + + 9 1 (6512) 

and so on for Z/4 + Z/8, etc. This provides a fast recursive algorithm for the 
computation of / at all dyadic ratiooals. If we choose to have a smoother spline 
interpolation than by piecewise linear splines (quadratic, cubic or even higher 
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order splines), then the formulas analogous to (6.5.9), (6.5.10), computing the 
f(2~ 3 n + 2— J_1 ) from the /(2— J fc)，would contain an infinite number of terms. 
It is possible to opt for smoother th 抑 linear spline approximation, with inter¬ 
polation formulas of the type 

/(2^n + 2—j— 1 ) = [a k f(2~ J (n-k)) , (6.5.13) 

k 

with only finitely many are nonzero; the resulting curves are no longer splines. 
An example is 

/(2~n + 2 十 ” --士 [/(2—"n —l)) + /(2i(n + 2)l 

+ #[/(2、) + /(2 ， +1 ))卜 (6.5.14) 

This example was studied in detail in Dubuc (1986), Dyn, Gregory, and Levin 
(1987), and generalized in, for example, Deslauricrs and Dubuc (1989) and Dyn 
and Levin (1989); it leads to an almost C 2 -function /. (For details on methods 
to determine the regularity of /, see Chapter 7.) Formula (6.5.14) describes an 
interpolation refinement scheme, in which, at every stage of the computation, 
the values computed earlier remain untouched, and only values at intermediate 
points need to be computed. One can also consider schemes where at every stage 
the values computed at the previous stage are further “refined,” corresponding 
to a more general refinement scheme of the type 

/ J+1 (2_” l n) = - (6.5.15) 

k 

Formula (6.5.15) corresponds in fact to two convolution schemes (with two masks, 
in the tcrmmology of the refinement literature), 


• f J+ i(2^n) = W— J k) (6.5.16) 

k 

(the refinement of already computed values), and 


/ J+1 (2”n + 2 十 = J> 2( „ * )+1 f 3 (2^k) (6.5.17) 

k 

(computation of values at new intermediate points). In a sensible refinement 
scheme, the f 3 converge, as j tends to oo, to a continuous (or smoother; see 
Chapter 7) function /oo- Note that (6.5.15) defines the f 3 only on the discrete 
set 2 - J Z. A precise statement of the “convergence” of /』 to the continuous 
function is that 


lim { sup 

卜 oo ^> 0 ,jteZ 





(6.5.18) 
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where the superscript A indicates the initial data, fo(n) — A n . The refinement 
scheme is said to converge if (6.5.18) holds for all A ^ see Cavaretta, 

Dahmen, and Micchelli (1991). (It is also possible to rephrase (6.5.18) by first 
introducing continuous functions mterpolating the see below.) A 

general refinement scheme is an interpolation scheme if ti^k = Sto, leading to 
f j+e (2^n) = fA2—n). 

In both cases, general refinement scheme or more restrictive interpolation 
scheme, it is easy to see that the linearity of the procedure implies that the limit 
function (which we suppose continuous 13 ) is given by 

foo(x) = ^/o(n) F(x-n), (6.5.19) 

n 

where F = Foo is the “fundamental solution, M obtained by the same refinement 
scheme from the initial data F 0 (n) = 6 n ,o. This hmdamental solution obeys 
a particular functional equation. To derive this equation, we first introduce 
functions fj(x) interpolating the discrete 

曹 

f 八 x) = u(2 j x - k) , (6.5.20) 

k 

where w is a “reasonable ” 14 function so that w(n) — 6 nt o. Two obvious choices 
are u{x) = 1 for —5 < x < 0 otherwise, or oj{x) = 1 - |x| for |ar| < 1 , 0 

otherwise. {These correspond to the two choices in the exposition of the cascade 
algorithm above.) The convergence requirement (6.5.18) can then be rewritten 
as \\fj — /4!|l«—►O for For the fundamental solution Fqo, we start from 

Fo(x) = u{x). The next two ^praximating functions F lt F 2 satisfy 

Fi(x) = Z 巧 (? 1 / 2 ) u;<2z _ n) (by (6.5.20) 

n 

=^2 w n w( 2 ar - n) (use (6.5.15) and Fo(n) = 

n 

- w n F 0 (2x-n) , " (6.5.21) 

n 

F 2 (x) = P2{n/A)u>(Ax~n) 

n 

= E w n- 2 h Fi(k/2) u(4x - n) (use (6.5.15)) 

n v Jb 

= ^2 Wk ^2 W( -/) (becauseFi(A:/2) = Wk) 

k t 

= ^kF x (2x-k). 
k 

This suggests that a similar formula should hold for all Fj ， i.e., 

Fj(x) - k) . (6.5.22) 

k 
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iDducticm shows that this is indeed the case: 

F 3+ i(x) - Y1 ^1(2^-^) u;(2^ +J x~n) 

n 

- XI 叫-狄 F i( 2 ~ Jfc ) 
n，fc 

=[ w n-2k Wt Fj-x(2~ i+1 k - (} w(2^ +1 a: - n) 

n,k t e 

(by the induction hypothesis) 

~ ^ S F i-j( 2 ~ i+Lm ) w «- 2m-2" w(2J +1 x - n) 

t m,n * 

-Y1 We .Yl W r -2m U}(2 J+1 X - 2 3 t - r) 

t m,r 

^ ^ W( 12 F j {2~ 3 r)^(V(2x ~i)~r) (by (6.5.15)) 

t m 

=Yl Wt F ^ 2x * ^ (V (6-5.20)). 


Since F — = liuij^oo F Jt (6.5.22) implies that the fundamental solution F 

satisfies 

F(x) w fc F(2x - k) . (6.5.23) 

k 

It is now clear how our compactly supported scaling functions ^ and the cascade 
algorithm fit into refinement schemes ： cm the one hand ， 沴 satisfies an equation of 
the type (6.5.23) (basically as a consequence of the multiresolution requirement 
Vq C VIi), and on the other hand the cascade algorithm corresponds exactly to 
(6.5.15), (6.5.20). Orthonormality in the underlying multiresolution framework 
made our life a little easier in the proof of Propositkm 6.5.2, but similar results 
can be proved for refinement schemes, without orthononnality of the F(x — n). 
Some basic results for refinement schemes are: 

• If the refinement scheme (6.5.15) converges, then W 2 n ~ tt ； 2 n+i = 
1 ’ and the associated functional equation (6.5.23) admits a unique contin¬ 
uous solution of compact support (up to n^malization). 

• If (6.5.23) admits a continuous compactly supported solution F, and if the 

F(x -n) are independent (i.e., the mapping ^*°(Z) ^n^( x ~ n ) 

is one-to-one 15 ), then the subdivifflon algorithm converges. 

For proo& of this and many other results, we refer to Cavaxetta, Dahmen, and 
Micchelli (1991) and papers cited there. Note that the condition J3 n ti^ n = 
52 n t» 2 n+i — 1 corresponds exactly to the requirements mo(0) — 1, mo(7r) = 0. 

In a sense, constructions of compactly supported scaling functions and 
wavelets can therefore be viewed as spedal cases of refinement schemes. I feel 
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that there is a difference in emphasis, however. A general refinement scheme is as¬ 
sociated with a scale of multiresolution spaces Vj, generated by the F(2~ J x — n), 
but typically no attention is paid at all to the complementary subspaces of the 
Vj in Vj^\- Refining a sequence of data points in j steps corresponds to finding 
a function in of which the projection onto Vo, as given by the adjoint of 
the refinement scheme (usually not an orthonormal projection), corresponds to 
the data sequence. There are many such functions in VLj, corresponding to the 
same data sequence, but the refinement scheme picks out the “minimal” ojie. 
There is no interest in the study of the other non-minimal solutions in VLj, and 
how they differ from the unique refinement solution. This is natural: refine¬ 
ment schemes are meant to build more “complicated” structures from simple 
ones (they go from Vo to V-j). In contrast, wavelet analysis wants to decompose 
arbitrary elements of V—j into building blocks in Vo and its complement. Here 
it is absolutely necessary to stress the importance of all the complement spaces 
Wi = Vt-\ © Ve, and to have fast algorithms to compute the coefficients in those 
spaces as well. This is where the wavelets enter, for which there is typically no 
analog in general refinement schemes. 

There is another, amusing linjc between orthonormal wavelet bases with com¬ 
pact support and refinement schemes: the mask associated with an orthonor¬ 
mal wavelet basis is always the “square root” of the mask of some interpola¬ 
tion scheme. More explicitly, define Mo(0 = fm 0 (^)| 2 — \ e —* 气 i.e” 

w n = ^2 k hk h k+n . Then the w n are the mask coefficients for an interpolation 
refinement scheme, since w 2n = hk hk+ 2 n = ^n,o (see (5.1.39)). In particular, 
as noticed by Shensa (1991), the interpolation refinement schemes obtained from 
the choice R = 0 in (6.1.11) are the so-called Lagrange interpolation schemes 
studied in detail by Deslauriers and Dubuc (1989), 16 of which (6.5.14) is an 
example. 

Note that it is impossible (except for the Haar case) for a finite orthonormal 
wavelet filter mp to be itself an interpolation filter as well ： orthonormality implies 
I 爪 o( 《 )j 2 + I 爪 o(《+ tt)| 2 — 1, while the interpolation requirement is equivalent to 
h 2n = or Tn 0 (^) + m 0 (^ -f 7r) = 1. If both requirements are met, then 

- • l = \mo(0\ 2 + \l-mo(0\ 2 , 


or 

h n^ + (6.5.24) 

• n V 

Assume that h n = 0 for n < n > iV 2 , and 九乂 / 0 / 九 w 3 ‘ Then (6.5.24) 
already implies that either Ni — Q or N 2 — 0. Suppose Ni = 0 (AT 2 = 0 is 
analogous); N 2 is necessarily odd, N 2 — 2L + 1. Take k = 2L in (6.5.24). Then 


ho h2L + hi h2L+l — h2L 


Since ho = 2 _1 / 2 ，and /12L+1 0 , this implies hi — 0 . Similarly k ~2L — 2 



leads to 
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- ■■■■ ——I ■ ■ I ii I —in i 11 

办 0 h，2L-2 + ^1 ^2L-1 + h，2 h2L + ^3 ^2L+1 = ^ 九 2l_2 ， 

which, together with h\ = 0, h^n ~ 2~ 1 / 2 ^„ i o implies /13 = 0. It follows eventu¬ 
ally that only Hq and h 2 L+i are nonzero; they are both equal to l/v^2, so that 
the mask is a “sUetched” Haar mask Orthonormality of the 你 ，„ then forces 
L = 0, or ?no(0 — |(1 + e—* 勺， i.e., the Haar basis. If we lift the restriction that 
m 0 is a trigonometric polynomial, i.e. ， if 彡，矽 can be supported on the whole 
real line，then m 0 (^) + m 0 (^ + 7 r) = 1 and [mo (^)| 2 4- |mo(C + 7r)| 2 = 1 can be 
satisfied simultaneously by non-trivial mo ； examples can be found in Evangelista 
(1992) or Lemarie-Malgouyres (1992). 

Notes. 

1 . A compactly supported <f> G L 2 (R) is automatically in Z^R) It then 
follows from Remark 5 at the end of §5.3 that mo(0) = 1, mo(7r) = 0, i e ， 
that mo has a zero of multiplicity at least 1 in 丌 . 

2. In Daubechies (1988b), the solutions P of (6.1.7) were found via two com¬ 
binatorial lemmas. The present more natural approach, using Bezout’s 
theorem, was pointed out to me by Y. Meyer. 

3. This formula for Pn was already obtained in Hermann (1971), where max¬ 
imally flat FIR filters were designed (without any perfect reconstruction 
schemes, however). 

4. This convergence also holds if infinitely many h n are nonzero, but if they 
decay sufficiently fast so that D |/i n |(l + [n|) c < cso for some € > 0. In that 
case I sin n^l < |rtC| max ^ 1,e ^ leads to a similar bound. 

5. We use here the classical formula 

' sinx 一，、 

- = ii cos( 2 - J ;r), 

An easy proof uses sin 2a — 2 cosq sin a to write 


II cos(2- J x) = 


sin( 2 _J+ 1 x) 


fJi 28 ^( 2 -^) 


sin 2 

2 J mn( 2 -J a:) 


which tends to for J—>- 00 . In Kac (1959) this formula is credited to 
Vieta, and used as a starting point for a delightful treatise on statistical 
independence. 

6 ‘ This is true in general: if tuq satisfies (6.1.1) and 沴 ， as defined by (6.2.2), 
generates a non-orthonormal family of translates 如 ， m then necessarily 
I 你 + 2 的卩 =0 for some f (See Cohen (1990b).) 
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7. The condition f dx tfy(x) i/(x -k)~ 6k t o may seem stronger than |)V>|j = 1 } 

but since the constitute a tij 由 t frame with frame constant 1, the two 

are equivalent, by Proposition 3.2.1. 

8 . Since is & finite linear combination of translates of <^(2a:), fast algo¬ 

rithms to plot 0 also lead to fast plots for if). Throughout this section’ we 
restrict our attention to 知 nly. r 

9. If ^ is not continuous, then the rjj still converge to 0 in Z 5 * (see §6.3). More- 
oweir, they converge to ^ pointwue in every point where 沴 is continuous. 

10v The choice c 2 = 1 was used in the proof of Proposition 3.3 in D&ubechies 
(1988b), because the are abBolutely integrable, whereag the f/j are not. 
In Daubechies (ld8$b) the convergence of the to 0 was actuary proved 
first (using some extra technical conditions), and orthonormality of the 
0 o,n was then deduced from this convergence. 


11 . Note that there exist many, other procedures fc 
lusted of a refinement cascade one can also 
and then compute the ^(2~ j k) directly from 


for plotting graphs of wavelets, 
start from appropriate 0(n) 
<K^) - ^ri0(2® - n). 

(In foct, when 0 is not continuous，the cascade ^.gorithm may cUvrarge, while 
this direct use of the 2>scale equation with appropriate <f>(n) 魷 ill converges. 
I would like to thank W. Sweldens for pointing this out to me.) This more 
direct oomputation can be d<»ie in a tree-like procedure; a different way of 
looking at this, avoiding the tree confiitruction and leading to faster plots, 
uses a dynamical systems framework, as developed by Berger and Wang 
(see Berger (1992) for a review). The “zoom in” feature is lost, however. 


12. Many experts on 
Bional case much : 


ement or subdivision sdiemes find the multidimen- 
interesting! 


13. This is not a presentfttion with fullest generality! We merely suppose that 
the Wk are such that there exists a continuous limit. This already implies 

— — 1 * 

14. Fbr example, any compactly supported a; with bounded variation would 
be M reaaonable w here. 


15. The following stretched Haar function shows how the F{x-n) can fail to be 
independent. Take wq =» 物 =1, all other w n : ^0. The solution to (6.5.23) 
is then (up to normalizatkni) F(x) = 1 for 0 < ar < 2 t 0 otherwise. In this 
case the —-sequence A defined by A„ = (-l) n leads to 2 n A n F(a:-n) = 0 
a.e. 

16. This is no coincidence. If we fix the length of the symmetric filter M 0 - 

|mo| 2 , then the choice R s 0 means that Mo Is divisible by (1 + coe《) 
with the highest possible nmttiplidly compatible with its length and the 
constraint 贫 ) =1- On the other hand, Lagrange refinement 
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schemes of order 2N - 1 are the interpolation schemes with the shortest 
length that reproduce all polynomials of order 2N - \ (or less) exactly 
from their integer samples. In terms of the filter e in ^， 

this means 

+ + ?r) = 1 (interpolation filter ： — 6 n ,o) 

and • 

W(0 = 1 + 0(^ 2N ) ^ 1+0((1-cose 广） 

(see Cavaretta, Dahmen, and Micchelli 
(1991), or Chapter 8). 

The two requirements together mean that W(^ + tt) has a zero of order 
2 N in ^ 0, i.e., that W(^ + n) is divisible by (1 - cos^; hence 阶⑹ 
by (1 4 - cos^) N - It follows that W — M 0 . 
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More About the Regularity of 
Compactly Supported Wavelets 


The regularity of the Meyer or the Battle-LemMie wavelets is easy to assess: the 
Meyer wavelet has compact Fourier transform, so that it is C°°, and the Battle- 
Lemarie wavelets are spline functions, more precisely, piecewise polynomial of 
degree A:, with (k — 1) continuous derivatives at the knots. The regularity of 
compactly supported orthonormal wavelets is harder to determine. Typically, 
they have a non-integer Holder exponent; moreover, they are more regular in 
some points than in others, as is already illustrated by Figure 6.3. This chapter 
presents a collection of tools that have been developed over the past few years 
r to study the regularity of these wavelets. All of these techniques rely on the fact 
;that 

[ ^ Cn «^(2x - n) t (7.0.1) 

r where only finitely many Cn are nonzero; the wavelet 必 ’ as a finite linear combina- 
I tion of translates of 0(2ar), then inherits the same regularity properties. It follows 
[that the techniques exposed in this chapter are not restricted to wavelets alone; 

【 they apply as well to the basic functions in subdivision schemes (see §6.5). Some 
of the tools discussed here ware in fact first developed for subdivision schemes, 

[and not for wavelets- 

The different techniques fall into two groups: those that prove decay for the 
[Fourier transform 多’ and those that work directly with 沴 itself. We will illustrate 
l each method by applying it to the family of examples N<i> constructed in §6.4. It 
;turns out that Fourier-based methods are better suited for asymptotic estimates 
(rate of regularity increase as is increased in the examples, for instance); the 
；second method gives more accurate loc^d estimates, but is often harder to use. 

References for the results in this chapter are Daubechias (1988b) and Cohen 
L (1990b) for §7.1.1; Cohen (1990b) and Cohen and Conze (1992) for §7.1.2; Cohen 
and Daubechies (1991) fw §7.1.3; Daubechies and Lagarias (1991, 1992), Mic- 
[chelli and Prautzsdi (1989), Dyn and Levin (1989), and Rioul (1991) for §7.2; 
'Daubechies (1990b) for §7.3. 

r7.1. Fourier-based methods. 

^The Fourier transform of equation (7.0.1) is 

t m - rnoim ki/2) , (7.1.1) 

\ 215 
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where mo (《)=\ Cne~ in ^ is & trigonometric polynomial. As we have seen 
many times before, (7.1.1) leads to 

m = n (7.i.2) 

i=i 

where wc have assumed mo(0) = 1 and j dx (j>{x) ~ 1, as usual. Moreover, 
mo can be factorized as 

mo(0 = m , (7.1.3) 

where £ is a trigonometric polynomial as well; this leads to 

m = ( 扣 )- i/2 fi £ (n ( 714 > 

A first method is based on a straightforward estimate of the growth of the infinite 
product of the £(2 - ^^) as |^|-»oo. 

7.1.1. Brute force methods. For qt = n-t-)3, n€N, 0</3<l t we define 
C a to be tl» set of &uictions / which are n times continuously differentiable and 
such that the nth derivative /( n ) is Holder continuous with exponent p, i.e” 

|/< n) (x) - / (n) (x + t)!< C\tf for aUar,t. 

It is well known and easy to check that if 

then f € C Q . In partkular, U \f(i)\ ^ C(1 + then it follows that 

f€ C a . It follows that, if the growths oo of njLi £(2 - 々 ） in (7.1.4) can 

be kept in check, then the factw ((1 — e~^)/i^) W ensures smoothness for 4>. 
Lemma 7.1.1. Ifq = gup ( j£(OI < then ^€0°. 

Proof. 

1. Since mo ⑼ = 1 ， C(0) = I; hence |iCK)| < 1 + C\%\. Consequently, 

sup n l £ (2"^)l < sup n exp [C2^m < e c . 

j=\ j=\ 

2. Now take any with |^| > 1. There exists J > 1 so that 2 J ~ X < |^j < 2 J . 
Hence 

n|£( 2-^)l = n l£(2-】《| n |£(2- ， 2- J «| 

< q J < C* 

< C ，f (1 -f . 
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Consequently, |0(OI < C m (1 + 吃 |) _ * _1_< ， and 碘 € C*。. ■ 


Grouping together several C leads to better «stimates t as follows. 
Lemma 7.1.2. Define 


Qj 

J-l 

=sup J] £(2~*$), 

(7.1.5) 


f U=o 



_ ㈣ 
~ 加2 ’ 

(7.1.6) 

K 

=inf fCj . 



Then K — li%—oo K 3 ; if K < N ~ \ ~ a t then <f> e C a . 


Proof. 

1. Take ji > j\. Then j 2 = nji + r with 0<r<ji, and 

<ln < (9jJ n Qi - 

Consequently, 1 

^ 〆 nlog^+rlog 仍 〆 ^ ^ ,,, 

'^2 ― + ° 31/32 ' 

2. For any € > 0, there exists jq so that K — infj > K Ja - t. For j > jo 
we then have Kj < /C + c + C jo/j —— ► )C + e. Since c was arbitrary, it 4 " 

J—*oo 

follows that K = linij-.oo K 3 . 

3. If/C<JV-l-a, then XI/ < N - 1 - a for some f e N. We can then 
repeat the argument in the proof of Lemma 7.1.1, 叩 plying it to 

* oo oo 

n r(2 — 弋 ）=n ， 

with — Il5:i an!d with 2^ playing the role of 2 in 

Lemma 7.1.1. This leads to |^(e)| < C(\ + < C(l + \^\)~ a ^\ 
hence <f> € C a . ■ 


The following lemma shows that in most cases, we will not be able to obtain 
much better by the brute force method. 

Lemma 7.1.3. There exists a sequence so that 

(i+feir^ n £ ( 2 ~^) 

>=l 


>C>0 . 
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Proof. 

1. By Theorem 6.3.1, the orthonormality of the </>(•-n) implies the existence 
of a compact set K congruent to [~7r,7r] modulo 2ir, such that [^)| > 
C > 0 for ^ € K. Since K is congruent to [—7r,7r] and Cg is periodic with 
period 2 /+1 7r, we have 

q t 念 sap = sup |^(0I » 

i.e., there exists Ce ^ 2^/if so that \£e(Q)\ = qi- Since K is compact, the 
2~ l Q ^ K are uniformly bounded. We therefore have 

K/l < 2 / ^ (7.1.7) 



for 0 < C. 


2. Moreover, since - (cos 《 /2| < 1, we have for all ^ € 2 e K, 

OO OO 

n A2* j o > n = m~ e o\>c>o. 


Putting it all together we find for = 20 


= mo)\ n £ (2 - j c/) 

|i=i I j=t+i 

> C a, = C2 tKt . 


By (7.1.7), 

OO 

(1 + | 貧 （ n A2- ⑹ 2 c 2^0 〃 2 -气 

j_=i 

Since K, — inf/ Kt, this is bounded below by a strictly positive constant. _ 


Let us now turn to the particular family of N<f> constructed in §6.4, and see how 
these estimates perform. We have 

Nmo(0 : ~ ⑹， 

with 

⑹ I 2 = P^(sin 2 C/2) = E 

Tl=0 \ 

We start by establishing a few elementary properties of Pn ， 
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^ Lemma 7.1.4. The polynomial Pj^(x) = ^ ^ n ^ x n satisfies 

f the following properties: 

! 0<x<y =» afU P N (x) > y~ N+l P N (y) , (7.1.8). 

I 0<x< 1 =» P N (x) < 2 N ~ l max (1, 2x) N ~ 1 . (7.1.9) 


Proof. 

1. If 0 < i < y, then 
x^^P N (x) ^ 



x ~(N-l-n) 


> 


E ( N ~n + n ) ym) = y* 1 ) h(y). 

n=0 \ / - 


2. Recall (see §6.1) that is the solution to 

x n P n (\-x) + P N (x) ^ 1 . 

On suhstituting x — it follows that Pjv{1/2) — 2 N ~ l . For x < we 
have Pn{x) < Pn{\) = 2 N ~ l because Ps is increasing. For x > ^ 
applying (7.1.8) leads to P N (x) < x N ^2 N - l P N (D 2 JV ~ l (2a:) Ar - 1 . This 
prov 明 (7.1.9). ■ 


It is now easy to apply Lemmas 7.1.1 and 7-1.2. We have 

sup|£iv(0!=- 


< 

Lemma 7.1.1 allows us to conclude that the n4> are continuous. In view of the 
graphs in Figure 6.3, which show the ^0 to have increasing degree of regularity 
as N increases, this is clearly not optimal! Using K 3 for j > 1 immediately leads 
to sharper results. We have, for instance, 

Q 2 = sup |£iv(0 C n {20\ 

C 

=sup Pn(4j/(1 - y))] l/2 

0<V<1 

(because sin 2 ^ = 4sin 2 《/2 (1 - sin 2 《 /2)). 



[ 2 ^ _ 1 ^( 1 / 2)] 1/2 = 2 n ~ 1 . 
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If either y < 1/2 or y > | + ^ (implying 4y(l - y) < |), then 
I^W(y)P"(4y(l - y))} S 沪 ⑼ - ” by (7.1.9). In the remaining window | ^ > 

y > I，we have 

Pftiv) P N m\-y)) < V^- 1 ) [16y a (l - y)}^ 1 

s 沪 ㈣ (嘉广 

(becausey 2 (l-y)< — for 0 <y < lj . 

Consequently 仍 S 3 - 3 ( 汉 -1 )’ 2 , and < (AT -1)(2 — | ^|]. It follows 

that asymptotically, for large N, n4^ € with M = | - 1 — .1887 - A 

slightly better vadue can be obtained by estimating 94 rather than 你； one finds 
thea /x ^ .1936. 

Note that y = | a fixed point for the map y 卜》 Ay{\ — y), so that qk > 
|F^(3/4)J* for any k, leading to a lower bound on /C^and an upper bound on the 
regularity of 0. In terms of 《， y = an* | = | correspond to 《 = 亨 ; we already 
saw earlier that 土亨 play a special role because { 夸， = 1 ^} is an invariant cycle 
for multiplication by 2 modulo 2ir. In the next suteection, we will see how these 
invariant cycles can be used to derive decay estimates for 4>. 


7.1.2. Decay estimates from invariaBt cycles. ITie values of £ at an 
invariant cycle give rise to lowra* bounds for the decay of 4>. 

Lemma 7.1.5. //{ 《 oji， …， C (-7r,7r) » any non-trivkd invariant 
cycle (i.e., Co ^ 0) for the map = 托 (modulo 2n), with — m = 

1， • ■ X 如 -1 = 《 0 , then，for al/ fc € N, 

0(2* M+1 6»)| > C(l + |2* m+1 61)一況 + *， 

where K = log j£( 《 m }j/(M log2}，and C > 0 w independent of k. 


Proof. 

1. First note that there exists Cj > 0 so that, for all A; € N, 

|sin(2* M ^ 0 )| > C Y . (7.1.10) 

Indeed, 2 fcM (。 = $0 (mod 2ir) f so that (7.1.10) follows if ^ 0 or 土 ?r. 
We already know that 《0 / 0 ； 过 Co = ±ir, then = 0 (mod 2?r) and hence 
^0 — 2 M_1 《i = 0 (mod 2 tt), which is nnpossible. 


2. Now 


m kM ^ 1 Co)i 


sin2* M 《o 

N 

2 fcAf & 



00 


n a2* m d 
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Since £ is a trigonometric polynomial and £(0) = 1, there exists C 2 so 
that |£(^)| > 1 ~ C 2 \^\ > e~ 2 Ca for |^| small enough. Hence，for r 
large enough, 


n 6)1 

j^rM 


> JJ exp (-2 C 2 2~ 3 |^oI ] 

jszrM 

> exp [»2 - rA/+2 C 2 led ] > c' 4Ca,foJ =C 3 . 


Hence 

m kM ^ 1 co)i 


(r+fe)M-l 

> cf (2 kM Kdi y N c 3 n f e。) 

/ =0 

> c 4 |£«o) AW - - aeM-i )| r+fc+1 (l + | 2 fcA# ^ol)- N 

> C 5 2 tMk (1 + \2 kM eol)*^ 

> <7(1 + |2* m+1 匕 |)-" + 亡 • ■ 


We can apply this to the example at the end*of the last subsection: Lemma 7.1.5 
impUes m n T)\ ^ C ( l + \2 n ^\)~ N+ ^, with ^ = log|/：(^) £(-f )|/21og2. 
If L has only real coeffic* i 4 -* (as is the case in most applications of practical 
interest), then |£(—^)| - j)|, an^ K = log |£(^)|/log2. The next short 

invariant cycles are 、， • 誓， — 夸 } ， { 亨，亨， — _} ， etc.; each of them gives 

an upper bound for the decay exponent of 

In some cases one of these upper bounds on a can be proved to be a lower 
bound as well. We first prove the following lemma. 

Lemma 7.1.6. Suppose that [-tt, n] Di UD 2 - - UDm, and that there exists 
q>0 so that 

\m\ < q 

'\m m )\< q 2 ^ d 2 


\C(0 ^eD M . 

m)\<C(l^ K|)- N+JC , with/C = log g/log 2. 


Proof. 


Let us estimate- 1 JIfc=o^( 2 *^) I » ^ or ®° me large but arbitrary j. Since 
^eD m for some m € {1 ， 2, * . ， Af }， 


llC[2- k 0 


fc«0 


<g f 


i 一 1 

n c ( 2 ~ k o 
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We can now apply the same trick to 2 _m ^, and keep doing so until we 
cannot go on. At that point we have 


U^ 2 ~ k ^ 


fc=o 




n c ( 2 — k o 

Ar—j —1—r 


with at most M - l different £-factors remaining fi.e., r < M — X). Hence 


n c ( 2 ~ k o 




幺 M+1 q M^l 


with qi defined as in (7.1.5). Consequently, with the definition (7.1.6), 

and K = lim 广 oo/Cj $ log qj log 2. The bound on 4> now follows from 
Lemma 7.1.2. ■ 

In particular, one has the following lemma. 

Lemma 7.1.7. Suppose that ^ 

\m\ < m 2 f)\ for i^i < ^, 

(7.1.11) 

, m) cm < \aw for ^ < ici < ^ • 

Then |^(^)| < C(1 + |《|) _N+#C ， with K = log |£(^))/^2, and this decay is 
optimal. 

Proof. The proof is a straightforwaf-d consequence of Lemmas 7.1.5 and 
7.1.6. ■ 

Of course, Lemma 7.1.7 is only applicable to very special C\ in most cases 
(7.1.11) will not be satisfied: there even exist £ for which ) = 0. Similar 
optimal bounds can be derived by using other invariant cycles as ^ reakpoints for a 
partition of [—7r,7r], and applying Lemma 7.1.6. Let us return to our “standard” 
example In this case Cohen and Conze (1992) proved that £ ； v(0 do 坊 
indeed satisfy (7.1.11), as follows. 

Lemma 7.1.8. For all N e N, N^>1, P N (y) = ^ n +n )^ n satisfies 

Pn(v) < Pn (f) */ 0<i / <| (7.1.12) 

PN(rfF J v(4y(l-j/))<[Pi V (|)] 2 if |<y<l . (7.U3) 

We start by proving yet another property of Fjy. 
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Lemma 7.1 9. 




N 


[P N (x)-P N (l)^- l l- 


(7.1.14) 


Proof. 




fN-l+n 


N-2 


E l n 


nx n ^ 1 = 


N + n 


x n 


^ - ⑺， - d 1 


(7.1,15) 


(1 — x)P w+1 ⑷ 


+ frr)-(-v) 

—⑺， +1 


W" — - ( 2N 、 


/vw + 


2N 




3， Combining (7.1 15) and (7 1.16) gives 

a - 抓⑷ =〜 卜⑷- 

Since 〜⑴ = Z^o{ N ^i + n ) - ("V 1 ), (7-1.14) follows. 


(71.16) 


We now tackle the proof of Lemma 7.L8. 

Proof of Lemma 7.1.8. 

1. Since Pn(v) is increasing on [0,1], we only need to prove (7.1.13). 

2. Define f(y) = P N (y) P N (iy(l - y)). Applying Lemma 7.1.9 leads to 




N 

h-yj(2y~.l) 


9{y) * 
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9{y) = Pn{v) Pn(4j/( 1 - y))(6y - 5) 

~y N ~ l { 2 y - 1)/V ⑴ Piv(4y(l - v)) 

+4(1- y)[4y(l - 广 ― 心⑴尸 at(V) • (7.1.17) 

3. Since 4y(l ~ y) < |/ for y > 3/4, we can apply (7,1.8) to derive 

Pn(v) V~ N+l < [4y(l - y)]- JV+l P N (4y(l-y)) 


or 

Wl-yr-^C^^P^yd-y)). 

Substituting this into (7.1.17) leads to 

^)<(6y-5) P N (4y(l~y)) [P N (y) - y N ~ l P N (1)]. 

The quantity in square brackets equals ^(1 - y)P f N (y) > 0 for y < 1, so 
that g(y) < 0 for | < y < |. It follows that /V(y) Pn^v{1 - y)) is 
decreasing on [J, f), which proves (7.1.13) for y < |. 

4. For § < y < 1 we follow a different strategy. Since Ps(y) < 
( 守 } Pjv(J) by Lemma 7.1.4, it suffices to prove 

(f 广 1 - 心〜⑴ . (7-1.18) 

But /V(4y(l - y)) < (1 - 4y(l - y)] -Ar = (2y - 1) _ ⑽ (because (1 - x) N 
Pn(x) -x n Pjv(1 - x ) < 1), and 

, 〜©$广_ 2 忐 3 ~— 1 ， (7119) 

where we have used Lemma 7.1,4 again, as well as 




To prove (7.1.18) it is therefore sufficient to prove 

,(2iTT?] (2v_irl -^(i) - (71,20) 

Since both (2y - l) -2 and y(2y - 1)~ 2 are decreasing on [|, 1], it suffices 
to verify that (7.1.20) holds for y = | T i.e., that 



This is true for N > 13. 
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to prove (7.1.13) for | < y < 1 and 1 < iV < 12. We do this in 
V <Vo ^ and y > jto- For y < 2^5, 4y(l - y) > 


It remains 
two steps: 
hence, again by Lemma 7.1.3, 


^(4y(l-y))< [8y(l - - [16^(1 - y)) N ~ l • 

Similarly P N {y) < (穿广 -1 P^(f), so that 


Pn(v) Pn(^v(i - y)) < 


< 


(ir-©- ( 7 


because y 2 (l — y) is decreasing on [|, One checks by numerical 

computation that (7.1.21) is indeed smaller than [Pjv(|)) 2 for 1 < N < 12. 


6 . For = to < y $ 1 we use the bounds /^(^(l-y)) < (2y- 1) _2N Mid 
Pn(v) < ( 念 to derive 


P N (4y(l - y))P N (y) < j^ N+1 /V(ito)(2j/ - 1 广 2 

< 2^ P N (yo) , (7.1.22) 

where the last inequality uses that (2y - l)~ a and y(2y - 1)~ 2 are both 
decreasing in [j/o, l]- One checks by numerical computation that (7.1.22) 
is smaller than [Pjv(|)J 2 for 5 < /V < 12. 


7. It remains to prove (7.1.13) for 1 < iV < 4 and < y < 1. For these 
small values of N the polynomial Pjv(y) iV(4y(l - y)) - /V(|) 2 haa degree 
at most 9, and its roots can be computed easily (numerically). One checks 
that there are none in )|, 1], whidi finishes the proof, because (7.1.13) is 
satisfied in y - 1. ■ 


It foUpws from Lemmas 

of jv^(0 : 


7.1.8 and 7.1.7 that we know the exact asymptotic decay 


|^«)|<^(1 + |^|)-/V+log|P w (3/4)|/2log2 


(7.1.23) 
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For the first few values of N this translates into with the following 

estimates for a: 


N 

a 

2 

.339 

3 

.636 

4 

.913 

5 

1.177 

6 

1.432 

7 

1.682 

8 

1.927 

9 

2.168 

10 

2.406 


We can also use Lemma 7.1.7 to estimate the smoothness of N<f> as N~*oo. 
Since - 

^ 3"- 1 

(use Lemma 7.1.4 for the upper bound, (7.1.19) for the lower bound), 




lQ ^ f ) f 工 黑邶-聲 ”。 g ⑽， 


implying that asymptotically, for large N, with =* 1 - ^ 

.2075. 1 One does not, in fact, need the full force of Lemma 7.1.8 to prove this 
asymptotic result: it is sufficient to prove that 


<C 3 n_1 for y < 


(7.1.24) 


iV(y) PN(iy{l-v))<C 2 forj<y<l, (7.1.25) 

With C independent of N. The asymptotic result then follows immediately from 
Lemma 7.1.6. The estimate (7.1.24) is immediate from Pn(v) < Pjv(J) < 
for y < I ； the estimate (7.1.25) follows easily from Lemma 7.1.4 as follows ， 
H I < |/ < then P N {y) Pf/{4y{l - y)) < (4y ) N-1 (16y( t l - = 

[64y 2 (l - because y 2 fl - y) is decreasing on if 

2^ < y < 1, then P N {y) P N (4y(l - y)) < (iy^P^) - (Sy )^ 1 < 
j 2 (N-i) xjjjg 咖也 simpler argument for the exact a^mptotic decay of 0 is due 
to Volkmer (1991), who derived it independently of Cohen and Conze^s work. 


7U. Littlewood-Paley type estimates. The estimates in this subsec> 
turn are L 1 or ^-estimates for (1 -t- Kl ) a 多 rather than pointwiBe decay es¬ 
timates for i itself. The basic idea is the usual Littlewood-Patey tech¬ 
nique: the Fburier transform of the function gets broken up into dyadic 
pieces (i.e，，roughly 2 J 'C < < 2^ +1 C) and the integral of eadi piece esti¬ 
mated. If ^ for j € N, then / 兴 (1 + Kt) a W«! < 
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C\\ + 2 ja A J j < oo if a < — log A/ log 2, implying ^ € C a . Td obtain esti¬ 
mates of this nature, we exploit the special structiare of ^ as the infinite product 
of mo(2D; the operator Po defined in §6.3 will be & basic tool in this derivation. 

We will first restrict ourselves to positive trigonometric polynomials Mo ⑹. 
(Later on, we will take Mq(Q = |mo(《)| 2 to extend our results to non-positive 
mo.) As in §6.3 we define the operator P 0 acting on 2ir-periodic functions by 

(Po,)(《)= 祕 °(!)/(!) + (I(I +ir ) * 

This operator was studied by Conze and Raugi and several of the results in 
this subsection come from their work (Conze and Raugi (1990), Conze (1991)). 
Similar ideas were also developed independently by Eirola (1991) and VUlemoes 
(1992). A first useful lemma is the following. 

Lemma 7.1.10. For allm>0 and all -periodic functions f, 




r2 m n 


f-2 m ir 




(7.1.26) 


Proof. 

1. By induction. For m — 1, 

= 2 /’ /2 劣 [Af 0 (C)/(O + M 0 (C 十貫 ) /K + ir)] 

ir/2 

. ， O ， ( I ) ⑴ : 

2. Suppose (7.1.26) holds for m = n. Then it holds for m = n + 1: 

- f\(Ps +1 mo = [\(p^Pofm 

•/一 IT 

=/ 2 " 屯 w>(2 十 1 o/n) 
y~2"ir 

+M 0 n+w/n+，)i ft 


2 n+1 / dC 


n^o 


[M>(0/(0 + iWb(C + ^r)/(C + 7T)] 
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n M w<) /(c) 

_J=0 • 


2 nfl rrfc 


. 2 n+l ir 


r - 2 "+»ir 




U M ^ j o 

J -0 


II M o( 2 -^} 


m 

/( 2 _ n H 


Since Mo is a positive trigonometric polynomial, it can be written as 
j 

A/o(0 = ^2 a 3 e _, ^ , with a 3 = a-j € R 

J 

= X^jCOS(j0. 

* 3=0 


One then finds that the (2«7 + l)-dimen8ional vector space of trigonometric poly¬ 
nomials defined tqr * 


vj - {/fo ； / = E 
{ 

is invariant for Pq. The action of Po in Vj can be represented by a (2J + 1) x 
(2J + 1) matrix which we will also denote by Po? 

、 (Po)w - 2a 2ib _r ~J<k, £<J ： - （ 7.1.27) 

with the convention a r = 0 if jrj > J. For Mq of the type 


M 0 ⑹ =^cofi0 2Jf L(0, (7.1.28) 


* where X is a trigonometric polynomial such that L{i^) ^ 0, the matrix Po has 
very special spectral properties. 

Lemma 7.1.11. The values 1 ， ！ ， … ， 2~ 2K+1 are eigenvalues for Po, Therxm 
vectors e* = {j k )j=-J, -Ji A = 0,… ， - 1 generate a subspace which is left 
invariant for Pq. More precisely, * 


e*Po = 2~ fc ejt + linear combination of the e n , n< k . 
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The factorization (7.1.28) is equivalent to 


a, j k (-iy = 0 forfc = 0, … ， 2 K —1 . 

=~J 

l ， : da , •木 i —晏番 This m68ns th&.t 

s matrix (7.1.27) is equal to 1; eo is thus a 
snvalue L 


(7.1.29) 


Moreover, since M 。 ⑼ = 1 ， 
sum of each column in the 
eigenvector of Pq with eige 


the 

left 


2. For d < ^ < 2K — 1, define i-e-, 

\ 

(9k)m = 2^ j* 02j~m - 
3 

For m even, m = 2 £， 

(9k)2t - 2^0* + ^ = 2_ * +1 !>) m E ( 上） （ 2 ，、 

J m j 、 / 

For m (xid, m — 2€+ 1, 

(fffc)2/+i — 2 y^(j + £ + * 

3 

= 2~ fc+1 53(況 + 1 广] ^ ( 上 ) (幻 + l) fc_7n ^ + i - 


Hence 


where 


e Jb^o — 9k = 2~ fc+l , 

mssA ' / 


Am = = X>, +1 (2j + l) m 

3 3 


by (7*1.29). 


of Lemma 7.1.11 is that the qpaoes 执， 


E h 


|/€V,; f 


j n fj = 0 for n = 0 ,…， 


^it3i 1< k < 2A\ are all right invariant for Po. The main result of this subsection 
»then the following. 
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Theorem 7.1.12. Let A be the eigenvalue of Po\b 2 k d 执执 e largest absolute 
value. Define F, a by - 

F(C) = (2ir) - " 2 f]Mo(2^0 , 
i=i 

a - -Iog|A|/log2 . 
then FeC a ~ € for all6>0. 

Proof. 

1. Define /( 《） =(1- cos^) K . Sinde 套 /|{=o = 0 for * < /if - l r / € E^k- 

2. The spectral radius p{PQ\Ei K ) equals (Af. Since, for any ^ > 0, there exists 
C > 0 so that ||yl n || < C{f^A) -f ^) n for all n 6 N, it follows that 

{JTf){0 < C(\M + 6 )'、 ^ (7X30) 


3. On the other hand, /(《）> 1 for | < \^\ < w. Together with the bound¬ 
edness of for | 4 | $ tt (derived as usual from )Af 0 (^)l < 

1 + C| 4 |), this implies 


j F (0 < c J JJm 0 ( 2 -^) 

2 n_1 7r<|(|<2 n »r 2*' l ir<l{|<2"ir 


2 n - l ir<|{|<2 n * 


di /( 2 — n C) nMo( 2 -^) =c[ di (nm) 


Lemma 7.1.10) 


^c^iAt+^r. 

By the argument at the start of this subsection，this implies F € C c 


In fact, a slightly stronger result can be proved. If we extend the definition of 
C 0 (n integer) to include all the ftmctions for which the (n — l)th derivative is 
in the Zygmund class 

〆 

^ = {/； |/(« + y) + /(x-y) - 2f(x)\ < C\y\ for all x t y }, 


then it is also true that F 6 C a if Po\Et K diagonal (i.e., we can drop the e in 
this case). Moreover, both this smoothies estimate and the estimate F € C a — C 
for all € > 0 in Theorem 7.1.12 are optimal if F has no zero on [-tt, tt[. For a 
proof, see Theorem 2.7 in Cohen and Daubechies (1991). 
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J^ 2 na 2 n/2 


n 二 0 


Remark. The same result can be derived via an equivalent technique, 
which uses an operator Pq defined in the same way as Po, but with Mo(^) 
replaced by the factor L(^) in (7.1.28). In this case we define X L = and 

we factorize F(0 - [2(sin^/2)/^] 2K (2T)- 1 / 2 n^：! L{2~^) to obtain 

j d^F(0 < C j de 旧 - 2K n [( 2 ”《） 
2" -I »<|£|<2 n ir 2" -1 *<l€I<2 n * J=1 

< c2- 2 " jc jTde[(p 0 L ri] (0 

< C2* 2n,r {A L +c) n , 

so that F € C a ~ € with a = 2K - This method has the advantage that we 
start directly with a smaller matrix P^ t so that the computation of the spectral 
radius is simpler. The two methods are comi^etely equivalent, as shown by the 
following argument. If /x is an eigenvalue of Fq» with eigenfunction C En 
then / M can be written as 


( sin i) 


Pm (0 - 


. m 

Replacing Mo(《）by its factorized form in 

- 财 ° ( 备 ) A (!) + ^ (I +7r ) (I + 7r )' 

we obtain after dividing by (sin 2 | cos 2 1]^, 

卩2 2 、(。 = I ( 蠢 X 臺） + 金 (f + 办(塞 + ， 

so that the eigenvalues of are exactly ^ven by — 2 2K fi. □ * 

In generd, mo will not be positive. (Indeed, in the framework of orthonormal 
wavelet bases, mo is never positive, except fw the Haar basis; see Janssen (1992).) 
However, we can then define Mq = |mo| 2 ; the same techniques lead to 

j d^\m\ 2 <c2- 2nN (\ L +er, 

2 n ~ 1 7r<|€|<2 n ir 

where X L is the spectral radius for P^ t with L(0 = |£(^)| 2 . Hence 

/dea+i^ir \m\ 


<c 


<00 


/2 

1 

\ -/ 

2 

01 
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if a + 5 < AT -t- Consequently (f> € C Q_e for a < iV + - j. 2 , 

For the special s<t> °f §6.4, the r 伤 ulting a，for the first few vsUues of N, are ： 


N 

a 

2 

.5 

3 

.915 

4 

1.275 

5 

1.596 

6 

1.888 

7 

2.158 

8 

2.415 

9 

2.661 

10 

2.902 


These are much better than the values obtained from the pointwise decay of 
(see §7.1.2). The size of the matrix Pq increases with N (linearly), and I do not 
know of any way to determine the asymptotics of its spectral radius as JV-*oo; 
for asymptotic estimates, pointwise decay of j is the best method. 


7.2. A direct method. 


The smoothness results obtained at the end of §7.1.3 for with small N are 
still not optimal. Moreover, Fourier-based methods can only give information 
on the global Holder exponent, whereas it is clear from Figure 6.3 that 2 小 ' for 
instance, is smoother in some points ths^i in others. In fact, we will see that 
there exists a whole hierarchy of (fractal) sets in which 20 has different Holder 
exponents, ranging from .55 to l. Results such as these can be obtsdned by direct 
methods, not involving 4>. For the sake of simplicity, I will explain the setup in 
t^e general case, but expose the method in detail for the example only, and 
Chen state the general theorems on global and local regularity without proof. 
Proofe can be found in Daubechies and Lagarias (1991, 1992). Similar results 
about the global regularity were also proved (independently, and in fact before 
Daubechies and Lagarias) in MiCchelli and Prautzsch (1989), in the framework 


of subdivision schemes. 、 

The method is completely independent of wavelet theory. The starting point 
is the equation 


F(x) = Y f c k F(2x~k) 


(7.2.1) 


k-0 


with ElfeLo c * ~ ^ we axe interested in the compactly supported i^-sohition 
F, which, if it exists, is uniquely determined 3 (up to its normalization): since 
F 6 L 1 , F is continuous, and (7.2.1) implies 


p(0 = (2n)- 1/2 ] r dx F(x)} , 

J j=i 
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with m( 《） = 晏 e 一辦 ， and Lemma 6.2.2 tl^n tells us that support F — 
[O’ K\. Equation (7.2.1) can be considered as a fixed point equation. Define, for 
functions g supported on [0, K], Tg by ^ 

K 

(Tg)(x) = ^c k g{2x~k ). 

k-0 

Then F solves (7.2.1) if TF = F. We will try to find this fixed point by the 
usual method: find a suitable Eq* define Fj — T j Fo^ and prove that F 3 has 
I a limit. To determine Fq, note first that (7.2.1) imposes a constraint cm the 
f values F(n) t n G Z if F is continuous. Since support F — [0, K], we only need 
I to determine the F(A:), \ < k < K — the other F(n) are zero. Substituting 
I x — k^\<k<K — \ into (7.2.1) leads to iC — 1 linear equations for the K - l 
I unknowns F(Jb); the system of equation^ can also be read as the requirement 
I that the vector (F(l), - - . ， F(K 1)} be an e^envector with eigenvalue 1 of a 
- (K - l) x (K — l)>dimensioiial matrix: derived from the c/t. It turns out that, 
f modulo some technical conditions (see below), this matrix does indeed have 1 
as a nondegenerate eigenvalue, so that (F ⑴， … ， F(K - 1 )) cian be fixed up to 
an overall multiplicative constant. Let us suppose this is done. One can prove 
that F(k) ^ 0, so we can fix the normali 聪 tion so that 二 1 F(k) = 1. 

(All this will be illustrated by an exampki b^ow.) D^ne now i*o(a:) to be the 
piecewise linear function which takes exactly the values F(k) at the integers, i.e., 

. F 0 (x) = F{k){k + 1 — ar) + 尸 (fc 十 l)(a: -fc) for fc < x < Jfc + 1 . (7.2.2) 

Successive applications of T define the Fj = T j jPo, i.e., 

K 

F j+ i(x)^ (TFjKx) = L C * F i(2x _ *) ; (7.2.3) 

*=o 

it easily follows that the Fj are piecewise linear with nodes at the 2~ j n e [ 0 , K], 
n € N. To discuss whether the Fj have a limit as and to study the 

regularity of this limit, it is convenient to recast (7.2.3) in another form. 

The key idea is to study the Fj{x), Fj(®+ 1 ) ••- Fj-(x+lC-l) simultaneously, 
for x € [ 0 , 1 ). We define v^(x) € R ^ 6 by 

' + A: = 1 ， ." ，凡， xe[0 ， lj. (7.2.4) 

Fbr 0 < a: < J, (7.2.3), together with suppcnt Fj C (0,iif], implies that F j+ i(x) t 
+ l),-** t F J+ i(ar K — l) are all linear combinations of Fj(2x), 
Fj(2x + 1 )， …， Fj(2x 十 /if — 1). More predsdy, in terms of v ; (x), 

Vj+i(x) — To vj(2x) for 0 < x < 5 , (7.2.5) 

where T 0 is the K ^ K matrix defined by 

(^o)mn ~ Cjm—n —1 » !• S ^ ^ K , (7.2.6) 




234 


CHAPTER 7 


with the convention — 0 for k <0 at k > K. Similarly, 

. v J+l (x) - T! ^(2^-1) for i < x < 1 , (7.2.7) 

二， « 
where 

曹 (^l)mn ~ c 2m— n » If 爪，灯 S 欠 • (7.2.8) 

Equations (7.2.5), (7.2.7) both apply for x = because of the special structure 
of T}) ， T\ and Vj (in particular, (7o)mn — (^Ti)mn+i ， [ 巧 ⑼ jn = i v j(l)]n f° r 
n = 2, ，， Jf)，the two equations are identical for a ： = 5 . We can combine 
(7.2.5) and (7.2.7) into a single vector equation as follows. Eveiy x e JO, 1] can 
be represented by a binary sequence, 

"* 00 

x ~ > ■: ^n( x ) 2 n , 
n=l 

with dn(x) = 1 or 0 for aU n. Strictly speat^ng，two possibilities exist for every 
dyadic rational x, i.e. every x of the type il; 2 ~ J : we can replace the last digit 
1 followed by all zeros by a digit 0 followed by all ones. This will not cause 
a problem, but to be clear we distinguish these two sequences by a subscript: 
di{x) for the sequence ending in zeros (the expansion “from above，” Le，，the 
expansion that will start by the same J — l digits as a ： 4 - 2~ J for J—oo) ， d~(x) 
for the sequence ending in ones (e 3 q>aDsioa “from below* 1 ). F<»: ^stan 從， 

4(1) = 1 ， n>2, . 

d ： (i) = 0, <(^) = 1, n>2. 

The two definition regions 0 < x < | and 5 < x < 1 of (7.2.5) and (7.2.7) are 
(x>mpletelyxbaracterized by di(x): di(x) = 0 if a: < 5 , 1 if x > 5 . 

For every binary sequence d = (^n)n€N\{ 0 } we also define its right shift rd 
by , • 

{rd)n = dn+i t n = 1 , 2, • 

It is then clear that rd{x) = d(2x) if 0 <,x < rd(x) = d(2x ~1) if | < a? < 1. 
(For x = I，we have two possibUities: rd^{\) — d(0), rd - (|) = Although 
r is really defined on binary sequences^ we will make a sli^it abuse of notation 
and write rx — y rather than rd(x) — d(y). With this new notation, we can 
rewrite (7.2,5), (7.2.7) as the single equation 

( V A TX )' (7.2.9) 

If the Vj have & limit t>, then this vector-valued function v will therefore be a 
fixed point of the linear operator T defined by 

\ 

(Tw)(x) = ⑷ w(rx ); 

T acts on all the vector-valued functions w : [0,1] ― ► thut satisfy the 

requirements ‘ 

M 0 )h = [tu(l)]if = 0, [w(0)jjt * (u>(l)]fc~i, …、 N . ， J7.2.10) 





MORE ABOUT COMPACTLY SUPPORTED WAVELETS 


235 


(As a result of these conditions Tw is defined unambiguously at the dyadic 
rationais: the two expansions lead to the ^me result.) 

What has all this recasting the equations into different forms done for us? 
Well, it follows from (7.2.9) that 

4(x) = T dl(x) T Mx) -T dj(x) vq(t 3 x ), 

which implies 


v 3 ( x )~ v j+dx) = T dl(x) 'T dj{x) (uotr^x) - vti^x)] . (7.2.11) 

In other words, information on the spectral properties of products of the Tjr 
matrices will help us to control the difference v 3 - v J+ ，，so that we can prove 
v 3 — * w, and derive smoothness for v. But let us turn to an example. 

For the function 20 (7.2.1) reads 


2 命 (r) = c H - A:) 

fc =0 


(7.2.12) 


•with 

co 

Note that 
and 


+ y/Z 


ci 


3 + \/3 


c 2 


3-V3 




V3 


Co +C2 = Cl + C3 


2c2 = ci + 3cs , 


both of which are consequences of the divisibility of mo ⑹ 
by (1 + e-^) 2 . The values 2 沴⑴， 2 4>(2) 


(7.2.13) 

(7.2.14) 


<) 2 . The values 2 沴⑴， 2^(2) are det 枕 mined by Uie 83 

(^(2)) = M (^S) ' ^ M = X 

Because of (7.i.l3), the columns of M all sum to 1, ensuring that (1, 1) is a left 
eigenvector of M with eigenvaiue 1. This eigenvalue is nondegen0*ate; the right 
eigenvector for the same eigenvalue is therefore not orihouomtal to (l f 1), which 
means it can be normalbsed so that the sum of its «dtried is 1. This diolce erf 
( 2 «1), 2 ^(2))lead8to 


7 m 


l + \/3 
- — 




— 


The matrices T 0 , r 2 
To = 


3 > S matrices by 


co 0 O' 

C3' Cl Co 
0 02 J 


Ti 


Cl Co 0\ 
Pa ci j 

.0 0 eg/ 
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Because of (7.2.13), To and T\ have a common left eigenvector cj =： ( 1 , 1 , 1 ) 
with eigenvalue 1 . Moreover, for all x e [ 0 ,l] r 

Cl - Vo(x) = C! - [(1 - x) Vo ⑼ + ac t»o(l)] 

― (l - *) W ⑴ + 2 沴 (2)1 + : [2 沴⑴ + 2彡 (2)1 

(use (7.2.4)) 

=1 . 

It follows that, for all a; e [0,1], all j e N, 

«i - V s (x) = €i-T rfl (,) vo(r J 'a：) 

- ci - voi^x) (because e\Td - cj. for d = 0, 1) 


Consequently, ”o(V) ~ 外 (y) E Fi ~ {u;; ei-w — wi +W 2 +W 3 — 0}, the space 
orthogtHial to In view of (7.2.11), we therefore only need to study products 
of Trf-matrices restricted to E\ in ord 枉 to control the convergence of the Vj. But 
more is true! Define €3 = ( 1 , 2, 3). Then (7.2.14) implies 


C 2 T 0 = ^2 + QoCl » 
€iTi = ^€2 + «iCi , 


(7,2.15) 


with cko — Co + 2oj — ^ Oi — cj + 2cs — ^ ~ . If W6 define 

c§ = C3 - 2ao «i, then (7.2.15) becomes 

c\Tq ^ \ and eJ T\ = | cj - J ei, or ej T d = | cj - 5 . 


On the other hand, 


e% - t^j(x) = (1 - ac) c® • 埘⑼ + x ej • = -x ; 


consequently, 

eS . 响 ） =eS • T dx{9) v^irx) 

=-\ <<iW + \ eS -^-Urx) 

3 

士 一 12 - m + 2— eg • «b(r^» 

m=l 

i 

=-E 2~ m 0)-2— t^x = -x . 
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It follows that e§ • [vo(a:) - — 0. This means that we only need to study 

products of T^-matrices restricted to the space spanned by e\ and e®, in 
order to control v) - v J+ t ， But, because this is a simple example, E 2 is one¬ 
dimensional, and Td\E % is simply multiplication by some constant, namely the 
third eigenvalue of 7^, which is 、士卢 for To* 1 - f for Ti. Consequently, 


IK(a ： )-v J+/ (ar)|i < 


•i + V5’ 

J 

1-V3 

4 


l + \/3 




C 


(7.2.16) 


where we have used that the vt are uniformly bounded. 6 Since j < 1， 

(7.2,16) implies 

\\v J (x)-v i+e (x)\\<C2-^ t 

with a = J log({l + \/3)/4)f/log2 — .550. It follows that the vf have a limit 
function v，which is continuous since all the v 3 are and since the convergence is 
uniform. Moreover v automaticaliy satisfies (7.2.10), sin 從 all the do, so that 
it can be “unfolded” into a continuous function F on [0,3]. This function solves 
(7.2.1), so that 2 必 = 尸， and it is uniformly approachable by piecewise Linear 
spline functions F 3 with nodes at the k2~° } 

\\24>-Fj\\l«>*<C2^ 3 . (7.2.17) 


It follows from standard spline theory (see, e.g.，Scfaumaker (1981)) 7 that 2 ^ is 
Holder continuous with exponent a = .550. Note that this is better than the best 
result in §7.1 (we found 0 — .5 — 6 at the end of §7.1.3). This Holder exponent 
is optimal: from (7.2.12) we have 






v 4 


20(1) = C2~ OJ 


2^(2' J ) = 2^(2' j+1 ) - • 
hence 

1 2 0(2” 卜 ㈣ 0)| C[2^) a . 

But this matrix method can do even better than determine the optimal Holder 
exponent. Since u(x) = we have, for t small enough 90 

x + t have the same first j digits in their binary expansion. 


that x and 


u(ar) - v(x + 0 = T dlix) - - - T dj{x) [v(— :) - ^(x + t))]. 

This can be studied in exactly the same way as Vj{x) — Vj + t(x) above; we find 
ei . [v(x) - v(ar +1)] — 0 , 


Fbr the 


remaindc 


e§ - [u(*) - v(x +1)] = t . 
only the Tj\b^ matter, and we find 


|Kx)-t;(ar + e)||<C|t| + 


TTTs 


(7.2.18) 
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wh^e t itself is of order T~K With the notation Tj(x) = y (口 *18) 

can be rewritten as 

Hx)-t;(x + f)||<CW + C 2-( rt+ 价 ; ( 训， (7.2.19) 

where (3 = |log|(l - >/3)/(l + >/3)||/log2. Suppose rj(x) tends to a limit r(x) 
for j—»oo. If r(x) < — .2368, then the second term in (7.2.19) dominates 

the first, and v，hence 2 ^, is Holder continuous with exponent a + pr{x). If I 
r(x) > then the first term, of order 2~ j t dominates, and 2 彡 is Lipschitz. In 
fact, one caoeven prove that 2 沴 is differentiable in these points，which constitute 
a set of full measure. This establishes a whole hierarchy of fractal sets (the sets 
on which r(x) takes some preassigned value) on which 2 ^ has different Holder 
exponents. And what happens at dyadic rationak? Well, there you can define 
r± (a:), depending on whether you come- “from above” (associated with d + (x)) 
or w from below” (dr (x)); r + (x) — 0 , r-(x) = 1 . As a consequence, 20 is left 
differentiable at dyadic rationals, x, but has Holder exponent *550 when x is 
approached from the right. This is illustrated by Figure 7.1, which shows blow¬ 
ups of 20 » exhibiting the characteristic lopsided peaks at even very fine scales. 



Fig. 7.1. Tht function 2 ^( 2 ) and tvw aucotttive Movups near x 0 = 2,5. 


In this example, we had two ^um rules* (7.2.13), (7.2,14)，reflecting that 
nio(0 = 姜 E* c * e ~ 叫 was divisible by ((1 + e~^)/2) 2 . In general* mo 
is divisible by ((1 + d/2 ) N ， 明 d we have N mm rules. ThiB subspaoe 
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will, however, be more than one-dimensional, which complicates estimates. The 
genial theorem about global regularity is as follows. 

Theorem 7.2.1. Assume that the c*, k = 0, * • •, /if, satisfy Cfc = 2 

And 

K 

5^(-1)* k e c k =0 for£ = 0, 1,* -,L . (7.2.20) 

Jb=0 

For every m = 1,-* • • ,L 4- 1, define E m to be the subspace of orthogonal 
to Uf 4 — Span { 勾 ， … ， em}, where e 3 — …， Assume that 

there exist 1/2 < X < l t 0 < £ < L(£ € N) and C > 0 such that, for all binary 
sequences (dj)j e n, and allm eN, 

\\T di - T dm \ B l+ A\<C X m 2~ me . (7.2.21) 

Then 

1. there exists a non-trivial continuous ^-solution F for the two-scale equa¬ 
tion (7.2.1) associated with the Cn, • 

2. this solution F is i times continuously differentiable, and 

3. if X > ^, then the £ih derivative of f is Holder continuous, with 
exponent at least |ln Aj/In 2; if X = 1/2, then the (th denvaiive of F 
is olmojit Lipschitz: it satisfies 

|F (/) (x + t)~ (x)\ < C\t\ |ln|t|| . 

Remark. The restriction A > | means only that we pick the largest possible 
integer ^ < L for which (7.2.21) holds with A < 1. If , = I’ then necessarily 
A > f ^ (see Daubechies and Lagarias (1992)); if ^ < X and A < |, then we could 
replace (by l+l and A by 2A, and (7.2.21) would hold for a larger integer L □ 

A simitar general theorem can be formulated for the local regularity fluctua¬ 
tions exhibited by the example of 2 伞 . For * precise statement, more details and 
proofs, I refer to Daubechies and Lagarias (1991, 1992). 

Whrai applied to the 尺炎 ， these methods lead to the following optimal Holder 
exponents: 


These are clearly better than what was obtained in §7.1.3;* moreover, we s«e to 
our surprise that 3 ^ is continuously differentiable, even though its grapk seems 
to have a ^peak” at x — 1 . Blowups show that this is deceptive: the true 
maximum lies a little to the right of : = 1 ， and everything is indeed smooth 
(see Figure 7.2). The derivative of 3 ^ is contlmious, but has a very small Holder 
exponent, as illustrated by Figure 7.3. 




0/3 珍 (*). 
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Unfortunately, these matrix methods are too cumbersome to treat large ex¬ 
amples. Another, more recent “direct method” has been developed in Dyn and 
Levin (1989) and Riotd (1991); when emptied to the n4> with iV = 2,3,4 it re¬ 
produces the a-values above; since it is computationally less heavy, it can also 
tackle larger values of N with better results than m §7.1.3 (see Rioul (1991)). 

Remarks. 

1 . Note the similarity of the matrices Tq, Ji and Pq in §7.1.3 (see (7.1.27))! 

ESv 抑 the spectral analysis, with the nested invariant subspaces, is the same. 
ITiis shows that the result in Theorem 7.1.12 is indeed optimal: if A is the 
spectra] radius then 

ii(r,u 3ff rii>c(A-6r 

so that A in (7.2.21) must be Bt least A2^, and the Holder expone 扯 is 
at most / + I log A|/ log2 < |log A}/log2. The difference between the two 
approaches is that the present method also gives optimal estimates if JWo(^) 
is not positive, unlike §7.1.3. 

2. The condition (7.2.21) suggests that infinitely many conditions on the 
To, T\ have to be checked before Theorem 7.2.1 can be applied. For¬ 
tunately, (7.2.21) can be reduced to equivalent conditions which can be 
checked in a finite-time computer search. For details, see Daubechies and 
Lagarias (1992). 

3. In practice, it is not necessary to work with To, T\ and restrict them 

to E 2 K. One can also define directly the matrices To, T\ corresponding 
to the coefficients of mo(^)/((l -f e~*^)/2) K \ it turns out that bounds on 
HTd, are equivalent to bounds on ||7^, - - |j - 2~ Lm (see 

Daubechies and Lagarias (1 拟 2), §5). The mc^rioes Tj are mudi smaller 
than ({N - K) x (N - K) instead oi N x N). □ 

Since tlus method works for any function satisfying an equation of the lype 
(7.2.1), we can apply it to the basic functions In subdivision schemes. For the 
Lagrangian interpolation hmetion corresponding to (6.5.14), a detailed ^uoalysis 
shows that F is "almoBt" C 2 : it is C 1 , and F* satisfies 

|rw-r(x+OI<C|t||k)g|t||. 

This had already been obtained previously by Dubuc (1986). But our matrix 
methods ca& do more! They can prove that F* is almost everywhere differen¬ 
tiable, and they can even compute F** where it 10 well defined. For details, see 
again Daubechies and Lagarias (19^2). 

7.3. Compact^ supported wavelets with more regularity. 

By Corollary 5.5.2, an orthonormal basis of Wavdeta can consist of C N-1 wavelets 
only if the basic wavelet 畛 has N vaniahing moments. (We implicitly assume 
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iV = 3 ho = .37432841633/v^ 
hi = .109093396059/v^ 
h 2 = .T86941229301/\/2 
h 3 = -,146269859213/V^ 
h A = -.161269645631/V5 
〜： .0553358986263 / >/2 

These examples correspond to a choice of a such that max[ p(To\E 4 ) t p(Ti\ Et )] 
is minimized; the eigenvalues of To, Tj are then degenerate . 8 One can prove 
that the Holder exponents of these two functions are at least .5864, 1.40198 
respectively, and at most .60017,1.4176; these last values are prolmbiy the true 
Holder exponents. For more details, see Daubechies (1990b). 

7.4. Regularity or vanishing moments? 

The examples in the previous section show that for fixed support width of 0 , 
or equivalently, for fixed length of the filters in the associated subband coding 
scheme, the choice of the hn that leads to maximum regularity is different from 
the choice with maximum number N of vanishing moments for 妒 . The question 


that stems from a multiresolution analyst and that ip have sufficient decay; 
both conditions are trivially satisfied for the compactly supported wavelet bases 
as constructed in Cliapter 6 .) This was our motivation to construct the 
which lead to n 寸 with N vanishing moments. The asymptotic results in §7.1.2 
show however that the jv^, € C mJV with \i ~ .2. This means that 80% of 
the zero moments are “wasted，” i.e.* the same regularity could be achieved with 
only iV/5 vanishing moments. 

Something similar happens for small values of N. For instance, 2 沴 is contin¬ 
uous but not C 1 , 3 ^ is C l but not C 5 *, even though 2^1 3 ^ have, respectively, 
two and three vanishing moments. We can therefore 1 *sacrifice , * in each of these 
two cases one of the vanishing moments and use the additional degree of freedom 
to obtain <f> with a better Holder deponent than 2 ^ or 3 ^ have，with the same 
support width. This amounts to replacing |m 0 (《)| 2 =fcos 2 ! 广 Pjy(sin 2 |) by 
l m o(C)P = (cos 2 |) N-1 [FN-i(sin 2 |) + a(sin 2 |) N cos《](see (6.1.11)), and to 
choose a so th^it the regutanty of ^ is improved. Examples for = 2 , 3 are 
shown in Figures 7.4 and 7.5; the corresponding h n are as follows: 




hoh^^3 
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Fig. 7.4 - acalmg function ♦ for the regtdar wavelet construction mih support 
width 3. 



FlG- 7.5. The scoUng /unction ^ for the most regular wavdct constructton with aupparC 
width 5. 

then arises: what is more important^ vanishing moments or regularity? The 
answer depends on the application, and is not always dear. Beylkin, Cotfinan, 
and Rokhlin (1991) use compactly supported orthonormal wavelets to compress 
large matrices, i.e., to reduce them to a q>arae form. For the details of this ap¬ 
plication, the reader should consult the or^incd paper, or the chapter by Beylkin 
in Ruskai et al. (1991); one of the things that make their method work is the 
number of vanishing moments. Suppose you want to decompose a function F(x) 
into wavelets (strictly speaking, matrices should be modelled by ^ function of 
two variables^ but the point is illustrated just as well, and in a simpler way, 
with one variable). You compute all the wavel^ Coefficients (F, and to 

compress all tbat information, you throw away all the coefficients smaller than 
some threshold e. Let us see what this means at some fine scale; j — —J 、 J e N 
and J “large.” If F is C L ~ l and ^ has L vanishing moments r then, for x near 
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we have 

F{x) = F{2~ J k) + F / (2~ J Ar)(a:-2- , ifc) 

+ •. + n 1 ,TT ( 2 ~ Jk )( x ~ 2 _J *0 L 一 1 + (X- 2~ J k) L R{x) t 

where R is bounded. If we multiply this by iff(2 J x - k) and integrate,-then the 
fi3rst L terms will not ccmtribute because f dx x e ip(x) = 0, £ = 0, - ,L ~ l. 
Consequently, 

m ^~j,k)\ - ydx{x~ 2- J k) L it(x) 2" 2 ^(2 J x-fe) 

< C 2 - jdy |# |^(y)j . 


For J large, this 甘 ill be negli^ldy small, unless A is very large near k2~ J . After 
thresholding, we will therefore only retain fine-scale wavelet coefficients near 
singularities of F or its derivatives. The effect will be all the more pronounced 
if the number L of vanishing moments of ^ is large. 9 Note that the regularity 
of iff does not play a role at all in this argument; it seems that for Beylkin, 
Coifman, and Rokhlin-type applications the number of vanishing moments is far 
more important than the regularity of 

For other applications, regularity may be more relevant. Suppose you want 
to compress the information in an image. Again, you* decompwe into wawlets 
(two-dimensional wavelets, e.g” associated with a tei^or product multiresolu¬ 
tion analysis), and you throw away sdl the small coefficients. (This is a rather 
primitive procedure. In practice, one chooses to allocate more precision to some 
coefficients than to others, by means of a quantization rule.) You end up with a 
representation of the type 


}MS 


where S is only a (small) subset of all the possible values, chosen in function 
of /. The mistakes you have made will consist of multiples of the deleted 寸上 jt. 
If these are very wild objects, then the difference between I and I might well 
be much more perceptible than If ^ 紅卸 loother. This is admittedly very much 
a hand-waving argument, but it suggests that at least some regularity might 
be required. Some first experiments repealed in Antonini et al. (1991) seem to 
confirm this, but more fsxpmimeBtsmB required for a convincing answer. 

The sum rules (7,2.20), eqtdvalentto the divisibility of mo(0 by (l+e^) L+1 , 
have another interesting consequence, in the exam^e studied in detcdl, 2 沴 ， we 
saw that (7^2.13) and (7.2.14) implied tihat 

ei • v(x) = 1, 邊 . r(x) = -x 


(we proved both for vj f so that they also bold for v — Unij-^oo v 】 ) ， or’ in terms 
of 0 rather than v ， 

4>(x) + <ft(x + 1) + (怎 + 2) = 1 , 
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(1 —»2ao) 多 ( 工 ） + (2 — 2 qq) <f>(x +• 1) + (3 — 2ao) 泠(工 + 2) = — x 

all x € [0,1]. Because support(^) = [0,3], one easily checks that this implies, 
for all y € R, 



^2 + n ) ^ 1 > 

n€Z 

^2 (n + 1 -2 q 0 ) (f>(y^n) = -y . 
net 

AQ polynomials of degree less than or equal to 1 can therefore be written as 
linear combinations of the <f>(x — n). Something similar happens in general: the 
conditions (7.2.20) ensure that all the polynomials of degree less than or equal 
to L can be generated by linear combinations of the <f>{x - n). (See Fix and 
Strain (1969) ， Cavaretta, Dahmen, said Micchelli (1991).) This can again be 
used to explain why the condition = 0， £ = 0,…， L is useful in 

^sublHaid filtering schemes. Ideally, one wants the low frequency channel, after 
the filtering, to contain all the slowly changing features, and to find only true 
"high frequency* features in the other channel. Polynomials of low degree are 
essentially slowly changing features, and the sum rules (7.2.20) ensure that they 
(or their restrictions to a large interval, to keep it all in L 2 (R); we disregard 
border effects here) are in every V>, i.e ， they are given completely by the low 
frequency channel. 

In the design of FIR filters fqr subband coding, it is not customary to pay 
much attention, to the number of vanishing moments of mo, which is reflected 
by the “flatness” of the filter at 《 = n. i0 What follows is yet another argument 
showing that in implementations where filters are cascaded, it is nevertheless 
importemt to have at least some zero moments. Suppose that we apply three 
successive low pass filtering + decimation steps to a signal. If we call the original 
signal /°, with Fourier transform /°(4) = Yl n fS then the result of one 

filtering + decimation is the sequence / 乂、 where f 1 ^) — e~ tn ^ satisfies 

尸 ⑷ = 夫[严⑴叫⑴+尸 ( f + *) 吻 (! + . ( 7 . 41 ) 

The second term can be viewed as the result of aliasing, due to the lower sampling 
rate in the f l . Similarly, three such operations lead to 


Z 3 ⑹ = 2- 3/2 [/° (!) mo (!) mo (!) mo (!) + 7 Yolding" termsj . 

(7.4.2) 

It follows that the product mott) mo(2^) mo(4^) plays an important role. Figure 
7.6 shows what this product lookB like for the ideal low pass filter, mo(0 = 1 
for |^| < ff/2, 0 for tt/2 < |^| < ?r. If the low pass filter is not ideal, then it will 
u leak n a little into the high-pass region v/2 < |^| < it. It is then important 
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Fio. 7.<t. PloU of mo<0, mo(2ir) ( mo (4() and o/ their yrvdwA for the ideal bw^pass fitter. 


to contain this leaJcage, especially when the fitters are cascaded: it contributes 
to the “folding" terms in (7.4.1) axid can lead to audible or viffiibte aliasing once 
quantization is introduced and perfect reconstruct— is no longer attained. In 
the ideal casein Figure 7.6, the “bump” of mo(2^) for ^ e [37r/4, it] is killed in 
the product moU) mo(24) mo(4C) because mo(C) = 0 in this interval. The same 
happens for extra “bumps” of mo(4^), resulting in moK), >no(4^) : 1 if 

^ 6 [0,7r/d[, = 0 if ^ € )7r/8,7r]. In the non-ideal case，a similar effect can be 
adiieved by imposing that mo have a zero of reasonable multiplicity at ^ = 7r, 
which “kilis” the maximum of mo(2^) in & concatenation. This phenomenon is 
illustrated in Figure 7.7, where a wavelet filter is compared with a non-wavelet 
perfect reconstruction filter. In Figure 7.7a we see plots of |mo(^)| for two or- 
thoDormal perfect reconstruction filters (i.e.，|mo(C) 卩 + |mo(C 十 ir)| 2 = 1)，each 
with eight taps; the filter on the left corresponds to the example constructed in 
§6.4, with two vanishing moments (i.e., mo has a zero with double multiplicity 
at ^ = tt), and an extra zero at 《 = 7tt/9. The filter on the right is not a wavelet 
filter, since mo(ir) ^ 0 and hence mo(0) ^ 1; It is constructed nu^e according to 
standard wisdom, with an “equi-rippl^ 0 design: in this case the location of the 
nodes is chosen so that the amplitude of the two ripples is the same as in the 
one ripple in the wavelet filter on the left, while keeping the transition band as 
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narrow as possible within this constraint. The resulting filter, is a little steeper 
than the wavelet filter (its first zero is at ^ = .767r rather than .78 tt for the 
wavelet example), and seems therefore closer to the ideal filter, (Of course, both 
are quite far from the ideal case’ but r^nember that we have used only eigfit 
taps!) Figure 7.To plots | mo ⑹ mo(2^) mo(44)] for these two examples, and 
Figure 7.7c- blows up these plots in the region 賞/2 < ^ < ^ - It is clear that 
in the second (non-wavelet) case the leakage into this high frequency region is 
more important than in the wavelet case; this is true in L 2 -sense as well as in 
amplitude (the highest peak at right is about 3 dB higher than at left). This 
effect can become even more pronounced when larger filters arc considered. 11 



b) 1.0 
0.5 

0 

0 n/2 n 0 n/2 

c} 0 03 二 
0.02 - 
0.01 - 
0 二 

n/2 3n/4 n n/2 3n/4 n 





Fig. 7.7. Comparison of three concatenationa of two 8-tap low-pass filters vnth tke perfect 
properlff ： (a) pht» o/ltno(OI» (W plots of |mo(() mo(2() mo(44)j, (c) blowups 

C < w- - 


of b for ir/2 < 


1. Incidentally, this proves that the statement in Remark 3 on p. 983 of 
Daubechies (1988b) is wrong-, I made a mistake in the extraction of a 
numerical value for /u from Mayer’s proof. ' 
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2. This is essentially what was done in the Appendix of Daubechies (19d8b). 
Beware of the typos in that Appendix, however! 

3. If the restriction that F is a compactly supported L 1 -function is removed, 

then many other solutions are possible. On the other hand 4 if we insist on 
compact support and F e L l , then necessarily =s 2*" +1 for some 

m € N, and F is the mth derivative of the compactly supported X 1 -solution 
to the equ&tion obtained after replacing the cu by 2 _m Cfc； no genera&ty is 
lost by the restriction c* = 2. For proofed see Daubcdiles and Lagarias 
(1991). 

4. In all the examples we will consider, it is not really necessary choose 
the particular Fo constructed later: the .algorithm would work with any Fo 
with int^ral one. 

5. We implicitly assume that the Ck are real. Everything still carries through 
for complex c*，but then v(ar) e C K . 

6. Equipping E\ in this special case with the norm |||(a, —a — 6,6)j|| 2 — 
a 2 + 6* (equivalent with the standard Euclidian iK>rm on Ej), one 
finds sup ta€JEl |j|r 0 t4|||/|||u||| - .728,8iw> tte£l |||11^||/||)«||| csr .859, so that 
HK+i(x) - Vj(x)||( < ^|||vi(x) - t^,(x)||j f with A - .869, by (7.2.11). It 
immediately follows that 

ll^(x)|| < NWII + IIK(x)- v^ixm 

<.|Mx)l! + d->4)- l q|Mx)- V o(x)|||, 

羼 

which is uniformly bounded in x and j. 

7. The following argument also gives a direct proof. Suppose that 2~^ +1 ^ < 

y — x < 2~ J . Then there exmts € € N so that one of the two following 
alternatives holds: (£- 1)2 _J <x <y< i2~^ or {I - 1)2~ J <x < £2~^ < 
y < (^ + 1)2~ J . We will only discuss the second case; the first is similar. 
We then have - 

l/W-/(y)l < (/(*)-/i(x)| 4 - \/^)~/^)\ 

+ \Mv)~f(y)\ 

< 2C2~^ + lMx)~ fj(£2^)l + |*(^)- , 

by (7.2.17). Because of the choice of t, there exists A € N so that a/ = 
x — k and = (2~ j - A; are both in [0, 1]. We coq moreover choose 
binary expansions for x* and t2"~^ with coinciding first j digits (choose 
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the expansion ending in ones for and if x f is dyadic，the expansion 
ending in zeros for x f ). It follows that 

2”勺|| 

=11^,(,/) - [t^(rV) - uo(r , (^2 _J ))] j| 


< C2S 

where we have used (17^ …7^|^|| < C 2~~ aJ , the boundedness of v 0 , and 
e Ei for all u f u f . Recall similarly bound |/ ； (y)- /#(◎—01; 
putting it all together leads to 

i/w _ /_ c 2-w wx ， 

which proves the Holder coptiouity with e^onent a. 

8. This corrects a mistake in the first printing, where a too large value was 
given for the Holder exponent for N — 2. I thank L. Villemoe& and C. 
Heil for pointing out this mistake to me. Incidentally, the N = 2 example 
• i&an instance where the best possible A in (7,2.21) is strictly larger than 
max{p(r 0 j 岛 ) ， p(Ti|£； t )]. In this case />(r 0 | 篇 J = p{Ti\ Bl ) = f, and 
f[pCToTf 2 )”’ 13 11.09946... > 1. 


9. Of course Beylkin, Coifman, and Eokhlin (1991) contains much more than 
this! For & large class of matrices it turns out that after an orthonormat 
basis transfcn^D using wavelets, dense N x N matrices reduce^to sparse 
structures with only O(N) entries Larger than the threshold e. The total 
I 2 -error made by throwing away all the entries below e turns out to be 
0(<), which is a much deeper result thaa th$ “compresskrii” explained 
h^e; it is essentially the T(l) theorem of David and Joam^r the proof of 
whidi usob M hard B analysis. 砉 

10. The argument below also holds for tlie bi(«thogonal case (see Chapter 8), 
where the flatness of |mo| at ^ = 0 and at 《 =need not be the same; it 
is the multiplicity of the zero at 《 ：貫 that counts. ♦ 

H. In Cohen and JohnstoQ (1992), filten are constructed which optimize crl- 
f “staodwd” 


that are a mixture of 


wisdom and wavelet desiderata. 




Symmetry for Compactly Supported 
Wavelet Bases 


All the examples we have seen so far of compactly supported cnthonormal wavelet 
bases are conspicuously non-symmetric, in contrast to the infinitely supported 
wavelet bases we saw before, such as the Meyer and Battle-Lemarie bases. In 
this diapter we discuss why this asymmetry occurs, what can be done about it> 
and whether anything should be done about it. , 

8.1. Absence of symmetry for compactly supported orthonormal 
wavelets. 

In Chapter 5 we already saw that a multiresolution anftl^is does not determine 
0, 矽 uniquely. This is again borne out by the following lemma. 

Lemma 8.1.1. If fnl^) - /(x - n) and g n (x) = g(x - n), n € Z, constitute 
orthonormal bases of the same sttbspaoe E of I 2 (R), then there exists a 2霄- 
peruxUc fttnchum o($) # with |o(0l — that g(^) = £>(0/(()， 

Proof. 

1. Since the / n are &n orthonormal baas iot E B g ~ a n/n, 
with K* 卩； llffll 2 = h Ccwisequently, « o(0 /(V), with 
°(0 = En^ne"*^. 

2. As shown in Chapter 5. orthonormality of the /(. - n) ia equivalent with 

Eml/(《- 2?rm )l 2 : (2 貫 ) _1 Similarly Em 2irm)| 2 - (叔广 1 . It 

foUowB that |a(《)| — 1. * 

However, we also have the following lemma. 

Lemma 8.1.2. If (a n )n€Z ** sequence (oli but finitely manya^ equcU 

0), and if |a(OI = i, thena n - aS ntno for tome «o € Z. 

Proof. • 

1. Since |a(0 卩 * 1, En ^ (8.U) 

2. Define ni,n 2 so that a ni 〆 0 # a na i a&d a n = 0 if n < ni or n > n 2 . 
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3. By (8.1.1), On or n+na ^ni - But, by the definition of «i, n 2> 

tbe sum confi&Bts of the single term cr ni S^，which is non 2 ero by definition. 
Hence ni — n^. ■ 


Together, these two lemmas imply that compactly supported ♦，岭 are unlqiie, for 
a given、muUiresolution analysis, up to a shift. 


Corollary 8.1.3. If' f t g are both compactly^ supported ， and the 
/ n = / (. — n), =〆• — n), n € Z one both orOionarrrud bases for the same 

space E, then g(x) = af(x - no) for iome a e C, |a| = 1 and no € 2. 


Prvof.] 
Because / t 
by Lemma 


By Lemma 8.1.1, 乡 (0 
g have ounpact supj>Oi 
8.1.2, a($) = 


=a(《)/(《)，with a n = f dx g(x)f(x - n). 
rt, only finitely many a n — 0. Consequently, 
hence g(x) — af(x - no), • 


In particular, if 珍 i ， 私 are both compactly supported, and 
normatbeed^ 1 scaling fonctions for the $ame joauitiresolution analysis, then 办 
is a shifted vetmon of the ccnistant a is necessarily l t because bjr convention 
f dx 02(ar) : 1 *= / dx ^i(ar) (see Chapter 5). This uniqueness result can be. 
used to prove that, except for the Haar basis, all real orthonormal wavelet bases 
with compact support are asymmetric. 

THEOREM 8.1.4. Suppose that 0 and i；, the seating function and wavetei 
associated with a multiresolution analysis, are both real and compadfy supported. 
//^ has either a symmetry or an antisymmetry axis, then ^ is the Hoar function. 


Prvof. 

1. We can ali_^s shift 彡 so tliat — j dx 0(a) (f>{x - n) « 0 for n < .0, 
/»o / 0. Since, is real, so are the hn. Let AT be the largest index for which 
hn does not vanish: ^ ^ 0, /in » 0 for n > i\T. Then N is odd，because 
N even, N 2no tc^ether with 

52 ^ 知 +M = 办 , 0 ， 

n " 

would lead to a ocmtradiction if / = no. 

2. Since support [0,jv), by Lemma 6.2.2. 2 The 

standard definition (5.1.34) then leads to support . = [—no, no + l]t where 
no =* 丑 The symmetry axis is therefore necesBarily at we haeve either 
V>(1 -x) — 0(*) or V>(1 - «)= - 矽 (i). 

3. Conadquently, 

办 ， *(-:) » ±2 - " a 妒 (2-’a? + * +1) 

which meana that the W^-spaoes are invariant under the map x 

Since VJ = Wk, Vj is invariant as well. 

*>i 
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4. D^ne bow 孑 (》) = tf>(N ♦ x). Thai the ^( - — nj generate an otthonormal 
basis of Vo (since V 0 is invariant for x «-> —ae) t / dx ^>(x) = fdx </>(x) — 1, 
and support ^ = suppoaft It fidiows from Corollary 8.1.3 that 多 = 沴 , 
i.e., if>(N - i)= 碘 (x). Consequently ， 


s/2 J dx 0(ar) <^(2x - n) 

V2 Jdx4^N-x)^N.~2x + n ； 

\/2 J dy 0(y) +(2p 一 汉 + n) = hff-tt 


5. On the other hand. 


hfi ^tt+2 / 〜 

n 

^ ^2m 托 2tn+2£ + J]) ^2tn+l 九 2m+2<+l 
mm 

^ ^2m h2m+2t + ^no-2m^2rH,-2m-2 / 

m m 

(use <8.1.2) on the second term) 

2 5^ h2 m h2m+2t - 


By Lemma 8.1.2, this implies /i 2 m == for some mo-€ Z, |a| = 

Since we assumed fto 一 0， this means tliat h 2m == ^m,o ot. By (8.1.2 )， 
hf/ = /to — a as well，and = ot £m t ne ^ general. The normalization 

Ehn = y/2 (see Chapter 5) fixes the value of a, a = ^. 

6. We have thus h 2m = ^ 6 m , 0 , h 2m +i ^ ^ ^n,no, or mo(《)=|(1 +e - 叫 ). 

It follows thal — (2n)'~ 1 ^ 2 {(1 — or <f>{x) = N^ 1 for 

0 < ar < N, ^(x) = 0 otherwise, ff iV : 1， then this gives exactly the Haar 
basis; if iV > 1, then the 0( - — n) axe not orthonormal, which contradicts 


the assuznptiCHis in the theorem. 


Remarks. 


The nonexisteiice of symmetHc or anti^mmetric real compactly supported 
wavdete should be no surprise to aoyiK>^ familiar with subbaad coding： 
it had already been noted by Smith and Barnwell (ld86) thftt symmetry 
is not compatible with the the exact reconstruction property in subband 
filtering. 'Rie only extra result of Theorem 8.1.4 is that symmetry <br if 
necessarily implies symmetry for the hn t but that is a rather intuitively 
true result anyway. 


2. If the restriction that <(> be real is lifted, 


<f> is compactly supported (Lawton, private 


then symmetry is possible, 
ate communication, 1990). 
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The asymmetry of aU the examples plotted in §6.4 is therefore uoavoiduble. But 
why should we care? Symmetry is nice, but can't we do without? For some 


applications it does not really matter at all. The numerical analysis applications 
in Beylkin, Coiftnan, and R^ckUn (1991), for instance, work very well with very 
asymmetric wavelets. For other ^>{^icatioos, the asymmetry can be a mmance. 
In image coding, for example, quantization errors will often be most prominent 
around edges in the images; it Is a property of our visual system that we are 
more tolerant of symmetric errors than asymmetric ones. In otl^r words, less 
asymmetry would result in greater ccmipressibility for the same perc^>tual 丨 
Moreover, symmetric filters make it easier to deal with the 
image (see also Chapter 10), another reason why the subband co 
literature often sticks to symmetry. The following subsections 
can do to make orthohormal wavelets less a^mmetric, or how 
symmetry if we give up orthononn&iity. 



8.1.1. Closer to linear phase. Symmetric filters are often cidled linear 
phase filters by engineers; if b filter is not symmetric’ thea its deviation from 
symmetry is judged by how mudbits phase deviates from a linear toction. More 
precisely，a filter with filter o>effidente a„ is called linear phase if the phase of 
the function is a linear function of i.e., if, for some t €Z } 

a(0^e-^\a(0\- 


This means that the a n axe symmetric around — a^-n* 
to this definition, the Haar filter mo(0 = (1 4 - e~*^)/2 
although the filter coefficients, are clearly symmetric. This 
are symmetric around | ^2; in this cate 


Note that according 
is not linear phase, 
is because tbe h 巧败 


mo(0 


-c 




if 0<^<7T ( 
if 7T < ^ < 2ir. 


The phase has a discontimiity at w, where [mol = 0. If we extend the definition 
of linear phase to include also tbe filters for which the phase of a ⑹ is ^ecewisQ 
linear, with constant slope’ and has discontinuities only where |a(^)j is then 
filters with the same symmetry bs the Haar filter are also induded. To make 
a filter “close” to symmetric, the idea is then to juggle with its phase so that 
it is “almost” linear. Let us apply this to the u standar(T constructkm of the 
n 也祕 given in §6.4. In that case we have 


[NtnoiOf - (cob m 2N ^v(sin 2 i/2 ), 

and the coefficients ^hn were determined by taking the “square root” of Pjq via 
spectral factorization. Typically Uiis means writing the polynomial L(z) t defined 
by L(e^) = Pjv (sin 2 ^/2), as a product of (z — zt){z - zg)(z - Zi)(z - zj 1 ) 
or (z - n)(z - rj l ) % where zt, ri are the complex, respectively, real roots of L, 
and selecting one pair {zg, zt} outci each quadruple of complex toots, and one 
value rt out of each pair of real Up to normalization； the resulting m。is 



then 
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jvmo(C) = —) • n 一 -It) J~[ (e^ <€ - r k ) 

^ ^ / t k 

The phase of nttiq can therefore be computed from the phase of each contribu¬ 
tion. Since 


- R( c^ to< )(e~*^ - Hi e**’）= e~*^{e~^ - 2Rg cosa/ + t*^) 

and 

( e -*€-r e ) = e-^ /2 {e^ 2 - r t e*^ 2 ), 
the corresponding pliase contributions are 

⑽ =arctg ( 诉 

and 

^Ai) - arctg ; tg f) * 

Let us diooee the valuation of arctg so thst ut continuous in [0, 2 tt], 拟 id 
0/(0) = 0; as shown by the example of Haar basis, this may not be the 
“true” phase： we have ironed out possible discontinuities. To-see how linear the 
phase is, this ironing out is exactly what we want to do, however. Moreover, we 
would like to extract only the nonlinear part of 电 /; we therefore define 




h 


^2tt) 


In §6.4 we systematically chc«e all the zt，rt witlTabeoiitte Vtdue less than 1 when 
we constructed This is a so-called ^extmnal phase” choice; it results in a 
total phase ^tot(0 = 2 / which is vefy itonlineBr (see Figure 8.1). In 

order to obtain as close to linear phase as possible, we have to choc^e the 
zeros to retain from every quadruplet or du|4et in such a way that 伞 to t (《）is as 
close to zero as possible. In practice, we have choices. This number can 

|- be reduced by another factor of 2: for every choice, the complementary choice 
I (choosing all the other zeros) leads to the oompleac conjugate mo (up to a phase 
% and therefore to the mirror image of 0. For iV = 2 or 3, there is therefore 
effectively only one pair 也 v. For iV > 4, one can compare the 2^ 2 ^ _1 
different graphs for 免 tot in order to find the doeest to linear phase. The net 
^fect of a change of choice from Z( t zt to z^ 1 , zf 1 will be most significant if Re 
k>cloee to 1, and if is dose to either 0 of W, In Figure 8.1 we show the graphs 
：&r for JST ; 4, 6, 8, 10, both for the or^pnal construction in §6.4, and for 
the case with flattest 毋 tot. Incidentally, in aU cases the original! constructitm 


^ooiTespo&ded to the least flat 爭 tot, i.e” to Uie most asymmetric (f>. The “least 
^asymmetric" 0 and 也 associated with the flattest possible 伞⑽， were plotted in 
iFIgure 6.4 for N — 4 1 6 1 8, 10; the ccnrrespoitdiiig filter coefficients were given in 
'6.3, for all N from 4 to 10. 
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Fig 8 1 The non-ltnear part 9tot(C) the phase of mo(0 for N — 4,6,8, and 10, 
for the extremal phase chotpe (laryett ampktude) and for the 0 clate^ io H^ear phtae" chtnce 
{ftaUest cwn/c). / 

h 

. * 

Remarks. 

1. In this discussion we have restricted ourselves to the case where mo and 
|£卩 are given by (6,1.10) and (6.1.12), respectively. This means that the 
<(> in Figure 6.4 are the least asymmetric possible, given that N moments 
of ^ are zero, and that ^ has support width 2N -X. (This is the minimum 
width for N vanishing moments.) If 0 may have larg 议 supjxnt width, then 
it can be made even more symmetric. These wider solu^oim correqjo&d 
to a choice 丑笋 0 in (6.1.11). The functions ^ in the next subsection ， 
for instance, are more symmetric than those in Figure 6.4, tnit they have 
larger support width. 

2 - One can achieve even more symmetry by going a little beyond the Stan¬ 
dard 1 * multiresolution scheme ex|5lained in Chapter 5. Suppose 7^ are 
the coe 伍 dents associated to a ^standard" multiresolution aniklysis and the 
corresponding orthcmonnal baais (compactly supported or not). Define 
functions ^ 1 , ^ 1 , 

<^(x) - ^ ^ 2 (2* - n), 

4> 2 {x) » ^ A-n ^(2» - n), 

^ ( 一 1 广九 -ff+1 0 a (2jg - n ) ， 
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矽 2 (x) = $ 52 (-”* 心 - 1 ^i 2x ~ n ) - 

n t* 

Then the same calculations as in Cb^t^ir 5 show that the functions 
- 2-^(2~^x - fc), H^ hk {x) - 2-i~^(2^x » k) 
(j, fe ^ Z) constitute an orthooomu^ basis for L 2 (R). Since the recursions 
above correspond to 

mo(|/4) Wo(C/8) motf/16) … 

=ft [mo(2^-^)mo(2^-2 «] ， 

i=i 

the phase of can be expected to be closer to linear phase than that of 

kO = X\Zi 汾 o(2D. Note abo that 0a(O = MO, 

hence <h(^) ~ <f>\( — x )^ ^ 2 ( x ) = ^i(-x). Figure 5.2 shows ，如 

computed from the h n for iV = 2, i.e. t ho - h x = h 2 = 

hz = (Unlike the previous construction, this “switching” makes 

a difference even for N = 2.) For the least asymmetric” /i n given in 

Table 6.3, this switching technique leads to slightly “better” 洽 ， but seems 

to have little effect on ip. □ 




fitters o/§6.4. 
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8.2. Colflets. 


In §7.4 
for ip: jt led to high 


advantage of having a high number of vanishing moments 
^ _ i compressibility because the fine scale wavelet coefficients 

of a function would be essentially zero where the function was smooth. Since 
f dx (j>{x) *= 1, the same thing can never happen for the Still, if 

J dx x e <f>(x) = 0 for , = 1 ， … ， i/, then we can apply the same Taylor expansion 
argument and conclude that for J large, {f u — f(2~ J k) i with an 

error that is negligibly small where / is smooth. This moans that we have a 
particularly simple quadrature rule to go from the samples of / to its fine scale 
coefficients (/, ♦一 j’k) ， R>r this reason, R. Coiftnan suggested is the spring of 
1989 that it might be worthwhile to construct orthonormal wavelet bases with 
vanishing*moments not only for but also for Id this sectiooi I give a brief 
account of how this can be done; more details are 珀 ven in Daubechies (1990b). 
Because they were first requested by Coi6neuti (with a view to applying them for 
the algorithms in Beylkin, Coi&nan, and Rokhlm), I have named tb^ resulting 
wavelets “coiflets, • 

The goal is to find 4> so that 


j dx xV 


(:)= 0, 


/ = 0,… ， jL — 1 


and 


J dx ^(x) = 1, J dx x e ^(x) = 0, £ — 1, 1; 


( 8 . 2 . 1 ) 


( 8 . 2 . 2 ) 


L is then called the ^rder of tl^s coiflet. We already know how to express (8.2.1) 
in terms of mo ； it 1$ equivaloat wth 


mo(0 - ( i± | ； ^) L - 


(8.2.3) 


What does (8.2.2) correspond to? It is equivaloit to the condition 套多 。 = ❶， 

£ = 1, • • • ,L - 1. Let us check what ^(0) — 0 means for mo. Because = 
mo(4/2) ^/2), we have 

.^(o - h km + \ mo«/2) : 


^(0) * \ mi(0) (2ir 广 V 2 + I 夕 (0 ) ， 


or 


< ⑼ =(2ir)"W ⑼. 

Consequently, / dx x0(x) = 0 is ecpilvalent with mj(0) — 0. Similarlyt one sees 
that (8.2.2) is equivalent with f 套 ij ) ^ 0, 1,***,L- 1, ot with 

mo(fl « 1 + (l-e-^) L £«)； (8.?.4) 
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where £ is a trigonometric polynomial. In addition to (8-2.3) and (8.2.4), mo 
will of course also have to satisfy = L L^t us specialize to 

L even (the easiest case, although odd L are not much harder), L ^ 2K. Then 
(8.2.3), {8.2.4) imply that we hove to find two trigonometric polynomials Vi,p 2 


so that 


Bec&usei 


(cos 51 m) - 1 + (sin 3 m) . (8.2.5) 

= e ~^ K ^cos 2 0 , (1 - c-^) alf == «-* K « ^2iain|y 


But we already know what the general saxh.P\, V 2 are: nothing 

other than the Bezout equation which we already solved in $6.1. fa particular) 
has the form 


嶋-處（欠 " i 1+Aj )( 細 2 9 + (细* !) 肌 

where / is an arbitrary trigonc^netric polynomial. It tl^n remains to taylor / 
in mo(i) = ((1 + e~^)/2) 2K Vi(0 so that |mo(OI 2 + 1 饥 o(f + 霄)1 2 = 1 is 
satisfied. With the ausatz /(《）= 1 /» e - *^, it is shown in Daubechies 

(1990) bow to Feduce this ^ayloring** to the solution of a system of K quadratic 
equations for K unknowns. A heuristic, perturbative argument su^^its that 
this system will have & solution for large K 、and ecplicit numeneal solutions are 
computed for if = 1, - • • ,5. Figure 8.3 sImjws the plots of the resulting 必，矽; the 
oorreeqponding coeffici 抑 ts are listed in Table 8.1. It is clear fircnn the figure that 
洽 ，矽扯 6 much more symmetric than the "妒 0 f §6.4, or even than the 沴，妒 in 

§8.2, but there is of course a price to pay: a coiflet with 2K vani&limg moments 
typically has support width 6JST - l t as compared to 4A" — 1 for 狄 沴. 


Remark. The ansatz /(^) - f n e~ in ^ is not the only possible 

one, but it makes the computations easier. For small values of Jif (^f — 1,2,3), 
different ansatzes are also tried out in Daubechies (td90b). It turns out that 
the smoothest coiflets (at least at these small values lor K) are not the most 
symmetric ones; for Jf = 1, for instance, there exists a (very asymnretric) colflet 
with Holder eiq>onent 1.191814, whereas the coiflet of order 2 in Figure 8.3 is 
ilot C l ; both have support width 5. Similalr gains of regulariiy can be found for 

K « 2 t 3. For graphs, coefficients and more details, see Daubediias (1990b). □ 


8.3. 


bogonal wa\ 
well known i 


As motioned above, it is well known in tihe subband filtering oommunity that 
symmetry and exact recanstruction are incompatible, if the same FIR filters are 
used for reconstruction and decompo»tkm* As soon 明 this last requixcmiaat is 


^iven up, «ymznetry is possible. This means that we replace the block diagram o| 
Pfgure 5.11 by Figure 8.4. Several que8tk»s nstura% arise: what does Figure 8.4 
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The coefficienU for of order L ^ 2K t iC =■ 1 to 5* (l^e eoeffidenU ar« normal 

%xed »o VuA their atm %a 1; (Aey are equal fa ih€ 2~~ l ^hn-) 



n 

hn/y/2 • 


n 

*n/\/2 

K^l 

-2 

- .062429728471 

/f 

0 

.553126463602 


-1 

23892972S471 


1 

、節 573261 明 


0 

.602859456942 


2 

-.047I1273S8G5 


1 

2 

3 

272140M30S8 

- 051429972847 

- 011070271529 


3 

4 

5 

* JW90381270R1 
.037813640163 
,017735837438 





6 

- .010766318617 

K 宏 2 

-4 

.011587596739 


7 

- .004001012886 


-3 

- .029320137980 


8 

.002652665^46 


-2 

— 047639590S10 


0 

.00089S594520 


-1 

273021046535 


10 

一 .000416500571 


0 

1 

.574682393857 

294867193696 


11 

12 

- .000183829769 
, .000044080354 


2 

- .054085607092 


13 

.000022082857 


3 

-.042026480461 


14 

- .000002304942 


4 

.016744410163 


15 

- .000001262175 


5 

.003967883613 





6 

- 001289203356 

- 000509505399 

K = 6 

-10 

- .0001499638 


7 


-9 

.0002535612 






观 5402457 

K^Z 

-6 

一 002682418671 


-7 

-.0029411108 


-5 

.005503126709 



- .0071637819 


-4 

.016583560479 
- .046507764479 


—5 

.0165520664 


-3 


-4 

.0199178043 


-2 

— .043220763560 


-3 

- .0649972628 


-1 

.386503335274 


-% 

-.0368000T36 


.0 

$61285256870 


-I 

.2980923235 


1 

.302983571773 

- 

0 

.5475054294 


2 

3 

4 

- .060770140755 
- 05819«2607»2 
.034434094321 


1 

2 

3 

.3097068490 
-.0438660508 
- 0746522389 


5 

.011229240962 


4 

.0291958795 


6 

一 .006369601011 
— .001820458916 
.000780205101 
.000329665174 
- .000050192775 


5 

.0231107770 


7 

8 

9 

10 


6 

7 

8 

0 

- .0139738879 
-.0064800900 
.0047830014 
.0017206647 


11 

- .000024465734 


10 

-.0011758222 

-.0004612270 



_ V 


11 

K^=4 

— 8 
-7 
-6 
-5 

.000630961046 

-.001152224852 

-.005194524036 

.011392459344 


12 

13 

14 

15 

.0002137398 
.0000993776 
— .00002^2321 
-.0000150720 


-4 

-3 

.018897236378 
- .057464234429 
-,039652648517 


16 

17 

18 

.0000026408 

.0000014593 

-.0000001184 


-1 

.29366739069 & 


19 

-.0000000673 
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mean in terms of multiresolution analysis? What do c 3 and d 3 now stand for? 
(They were coefficients of orthogoiu^ projections in Chester 5.) ts there an 
associated wavelet basis? How does it differ from the bas^ constructed earlier? 
The answer is that, provided the filters satisfy certain technical conditions, such 
■a scheme corresponds to two dual wavelet bases, associated with two different 
multiresolution ladders. In this section we will see how to prove all this, and give 
several families of (symmetric!) examples. Except for an improved argument due 
to Cohen and Daub^dties (1992), all these results are from Cohen,'Daubechies， 
and Feauveau (1992). Many of the Bame examples are also deiived independently 
in Vettcrli aod Herley (1990), who present a treatment from the “filter design” 
point of yie«r. 



Fig 

different 


84 

from 


Subband fittenng 
the deafmpositt<m 


scheme 

fitters. 


mth emct recomtrucUon bvt vecimstructum filters 


8.3.1. Exact reconstruction. Since we have now four filter instead of two, 4 
we have to rewrite (5>fr.5), (5.6.6) as 

4 kk ~ in C * * C * 

■ k k 

and 

C ? = E 卜 2 » 4 + 办 . 

n 

In the ^-notation introduced in §5.6, this can be rewritten as 
c°{z) = \ ^( 2 ) 句 4 十辦幻択怎))汐(之） 

+ ^ [Kz)h{-z) + g{z) ^(-z)] ^(-z) . 

Consequently, w require 

h(z) l(z) + §(z) ^(z) * 2 , (8.3.1) 

'ft(z) S (— 2 ) + 备 (z) 射 一z) = 0 ， (8.3.2) 

where wp assume to be polynomials since the filters are aJ3 FIR. (Fbr 

eimj^kiky, we me the term ^polyooniU^” & slightly wider sense th 抑 tutu&l： 



SYMMETRY FOR COMPACTLY SUPPORTED WAVELET BASES 263 


i we also allow negative powers. In other words’ is a polynomiaHn 

this terminology.) FVom (8.3.1) it follows that % aad g have no common zeros; 
、 consequently, (8.3.2) implies that 

§( 2 ) = h{-z)f^z\, h(z) = -g(-z)p(z) (8.3.3) 

I for some polynomial p. Substitution into (8.3.1) leads to 

p(z)[h(-z)g(z)~k(z)g(-z)] = 2. 

The only polynomials that divide ccmsta&ts are monomials*, hence 

p(z) = az k 

for some a € C, Ar € Z, and (8.3.3) bacoibes 


g(z) = az k hl-z), ff(z) = -a~ 1 (-l) k z k h(~z) . (8.34) 

1 Any choice for a and k will do; we choose a = J, A = 1, which maJces the 

; equations (8.3.4) for g and g symmetric. ^Substitution into (8-3.1) gives 

h(z) h(z) -f h(~z) h{-z) = 2 . (8.3.5) 

In terms of the filter coe 历 dents’ all this becomes 

[hn ^n+2fc * 5fc,o > (8-3.6) 

n 

9n = P« * (-l) n+1 A- n+1 , (8.3.7) 


where wc have implicitly assumed that all the coefficients are real. These equa¬ 
tions are obvious generalizations of (5.1.39), (5.1.34). 

8.3.2. Scaling ftiDCtions and wavelets, ^cause we have two pairs ai fil¬ 
ters, we also have two pairB of seeding function + w&vekt: 沴 , V* and H Tl»y 
are defined by 

m = mo(C/2) 把 /2) t - f«o«/2) 1(^/2) ? (8.3.8) 

m = m^/2) $(0 = mi«/2)|«/2) , (8.3.9) 

where mo ⑹二士 e ~*' 叫 (0 = ^5 Sn c ' in€ ； ^k), m •» defined 

analogously. Note that (8.3.7) implies 

- moK + ir), mj(^) = mof^+ jrj (8.3.10) 

We saw in Chapter 3 that in order to generate wavelet Rieaz bases, and 磷 
have to ^(0) s= 0 — ^(0). A ooGessazy coodition Is therefore mj ⑼ =* 0 = 
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mifO); in terms of the poljmomialB 所 z)， h(z) this is equivalent to h{—l) — 0 ~ 
ft(-l). Sttbstitution into (8.3.5) th«n leadSio /i(l) 各⑴ = 2, or 

This implies that can normalize both h and h so that h n ^ >/2 = 
J2 n h„. Consequently, mo ⑼ ：1 ⑼， and we caa solve (8.3.8) by defining 

/ 

kO - (^r in n mo(2->fl t 
’ 卢 1 

ko - {^r if2 n 咖 (n 

/=i 

The same arguments as in Chapter 6 show that these infinite products converge 
uniformly on compact sets，and that 0 and 4> have compact suppcart, with sup¬ 
port width ^ven by the filter lengths. As finite linear combinations of <j> and 彡， 
必 and also have compact support. This is by no means sufficient to guarantee 
that the 分 j，* = 2~" 2 妒 (2- — A:) and ^ t k are dual Rie» bases of wavelets, 
however. Indeed, even in the orthogonal case (reconstruction filters — decotnpo- 
silion filters), it was possible for 妒 to fail tQ generate an orthonormal basis (see 
§6.2, §6.3). In this nonorthogonal case we have to be even more careM. Let us 
summarize the different steps in the argument proving that we have dual wavelet 
bases (with certain re^rictiomi). 

First of all, if 0, ^ € JL 2 (R) (which will have to be proved too! See below.) 
then we can define bounded operators Tf by 

{Tjf, ir) - {/, 9 ). 

k < 

wh^re 

炎 M 〒2_" 2 ^x-kl = 2_" 2 0(2*4-A:), 

as usual. 8 A consequence of the definitions (8.3.8), (8.3.9) is 

- ^2 如 ， k * 不 l，n = ^*-2n 4>0 t k i 

k k 

in,n( x ) ** 5^ ffk-Jn 如》*， ^1,« = S ^0,* ； 

k k 
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The same trick can be allied for other values of j; ^telescoping 1 * all the identities 
together leads to ^ 

E = (T-j-iLs)- (Tjf t g) 

—J t 

- 53 (J 南、 k)(h,k 、 必 

k k 


Exactly the same arguments as in Cha|>ter 5, used in the estimation of (5.3.9), 
(5.3.13) ， respectively, show that (Tjf t g) ― ► 0, (T_j/,p)->{/,p>, for J-^oo. 
Consequently, 


Y, </ 為， / K 心， i /> = </. P ) 


(8.3.11) 


or, in 


/ = lim Yl £ {Hdh. 

This is not sufficient to establish that the constitute dual Riesz bases. 

For one things the or xjj^t may foil ta constitute frames; in this Gaae the 
convergence in (8.3.11) could depend cnidally on the order of summatkm. To 
avoid this, we need to impose that 

converge fw all / 6 L 2 (R), or equivalently, 

E K/ 為 ,*>l 2 以 ll/ll 2 ， E K/ ， ^)l 2 < A H/ll 2 . (8.3.12) 

M j，* 

If these upper bounds hold, then it follows from (8.3.11) that 6 

' E |(/,^)i 2 >i- 1 ll/ll 2 , E \(f^k)\ 2 >A-}\\ff t 

i,fc i，Jfe 

so that we automatically have frames. But even then the ^ Jt *, 夺从 may merely be 
(redundant) dual franicB and not dual Riesz bases; this redundancy i8 dUminated 
by th^requimuent _ 

t » (8.3.13) 

which, «xacyy Uioe in the orthononnal c$m (see J6.2), can be shown to be equiv¬ 
alent with - 

<00, Jbi^o,^) == • 


(8.3.14) 
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If the conditions (8.3.12) aad (S.3.14) aie satined (we will come l*ack to 
them shortly), then we do indeed have two multiresolution analysis ladders. 

… V 2 C Vi C V^> C VLj C V-2 C …， 

… K 2 C Vi C Vq C V-i C f_2'C …， 

with Vq as Span k 6 Z} f Vp = Span {^p tk ; k e Z}. The spaces 
Wj =* Span {^ Jf k； 1c e Z} t W } = Span k € Z} u*e agsuin coraplements 
cS V } , respectively, V} in VJ, lt respectively, V 3 -u but they dxejao% <a-tfaogonal 
complements： typically the angle 7 between Vj,W } or Wj wiS be ^nailer than 
90°. This is the reason why we have to prove (8.3.12) in this case，wteeas it was 
automatic in the orthonormal case. Another way of seeing this is the following. 
Because of the non-orthogonality we have 

«E0(/.^>i 2 + i(/.^)i 2 )<x ； 


0 E K/ 為 ， *>l 2 + ' 


with a < 1, )3 > 1 (in the orthogonal case，equality holds, with at = 泠 =1) 
Utilike the orthonormal case, we cannot telescope these mequaliti 拍 to prove 
that the ^ 3) k constitute & Riesz telescoping would lead to a blowiifMrf the 
constants.- We therefore have to follow a different strategy. Note that (8.3.13) 
implies that VVj 丄 % 丄 The two multiresolution hierardiies and their 
sequences of complement spaces fit together like a giant zipper, and this is what 
allows us to control expressions like {{/,^j r *)| 2 * 

But let us return to cooditions (8.3.12) and (8.3.14). We already saw 
how to tackle condition (8.3.14) in §6.3, in the simpler orthogon^ ca^. Our 
strategy here is essentially the sune. We again define an operator Pq acting on 
27r-periodic functions, 


(Po/)(0 


(81 ’ ⑴ 


黍 second operator Po is defined anatogmisly. In terms of the Fourier a>effidents 
of / t the action of Pq is given by 


^ (y^ fem hm+t-ik ) ft 


we will be mostly iutcrestec 
that we can t«stdc 
subspace of / for which ft 


crested in invariimt trigonometric polynomials for P 0 - This 
restrict our attention to the 2[N^ - N{) + 1-dimensional 


suDspace 01 / tor wmcn // = 0 if / > AT a - /v! (we assume ft n a u u n < iVx 
«w n > Nq) 1 on whidi Po is represented & matrix. Theorems 6.3.1 and 6.3.4 
have the following analog. 

Theorem 8.3.1. The following three statements are equivalent: 


A 0 if n < iVi 
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V 

1. Z/ 2 (R) and (0o,fc) ^o,t) — - 

2. There exist $tnctly posittve trigonometric polynomials / 0 ,/o invariant for 
Fo* Poi there also exists a compact set K congruent to tt] modulo 2n 
so that 

d M 2 々 )i > o ， d> o • 

3. There exist strictly positive trigonometric polynomials / 0 , /o invariant for 
Po» Po, ond these are the only invarimt polynomials for Pq» Po (up to 
norrrudization). 

The proof is very similar to the proofe m Chapter-6, but a bit more compli¬ 
cated. In |6.3, the functions /o, /o were simply coostaat; in this case，they are 

essentially f 0 (0 = Yle + 2irt)\ 2 , /o(0 = 2/ 减 (《 + 2^)| 2 . For details on 
how to adapt the proofs of §6.3 to the present case, see Cohen, Daubechies, and 
Peauveau (1992). • 

Condition (8.3,14) therefore simply amounts to checking that two matrices 
have a nondegenerate eigenvalue 1 and that the entries of the corresponding 
eigenvectors define a strictly positive trigonometric polynomial. (Note that if the 
trigonometric polynomial takes negative values, then <f> ^ L 2 (R). This happens 
for some exact reconstruction filter quadruplets.) Condition (8.3.12) is something 
we had not encountered in the orthogonal case. It turns out that this condition 
is 8ati«|6ed if any of the three conditicms in Theorem S.3.1 holds. The proof of 
this surprising fact is in the following st 印 b 8 : 

• First, one shows that the existence of an ^genvahie A of Pq with |A| > 1, 
A ^ 1 would contradict the square integrabiltty of It follows there¬ 
fore from Theorem 8.3.1 that all the other eigenvalues of Po have abso¬ 
lute value strictly smaller than 1 if the eigenvalue 1 is nondegenerate and 
the associated eigenvector corTespcmds to a strictly positive trigonometric 
polynomial. The proof of this step uses Lemma 7,1.10. 

• Since mo(?r)_= 0 = mo(7r) f we have obviously Afo(ff) = \mo{n)\ 2 = 0 = 

|mo(7r)|? = Wfe saw in Charter 7 that this means that tbe columns 

o£ the matrix representing Pq all sum to 1, so t\mt the row vector (of the 
appropriate dimension) with all entries 1 is a left eigenvector for Pq with 
eigenvalue 1. It fellows from the ficst point that p, the spectral radius of 
Pq\bi »with Ei = {/; Yin fn — 0}»« strictly 9 nudler than l. One then uses 
that f( 《 ) — 1-cos^isinF! to prove (the estimates are analogous to those 
in the proof of Theorem 7.1.12) that < C (平) ' 

• Via Holder's inequality this implies Jd^ < oo for sufficiently 

small 6, ^ This can then be uaed to prove a “discretized” version, 
SmeZ + <C<ooforalIC6R, again for 
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small B*. Because n»i is bounded, i> 助 ttisfies a awnilM^ bound, 

^2 + 2irm)i 2 < 1 -^) < C < tx> . (8.3.15, 

n»€Z 


• On the other hand, one calk also prove that 

8«P y ； W2^)| M， < oo . (8.3.16) 

^<m<^ ^ . 

a 

Since ^ is entire and ^(0) = 0» |^($)| < C|^| for suffidently small 阳， so 
that ^ = ^ oe> |^(2 ? ^)| w， is uniformly bounded for |^| < 2ir, and we only 
need to concentrate on j > 0 in (8.3.16). But 




m |h?(e)p 


<2 J W4)| 

2 J ir<^J<2^ +l # 

<^1 j dC 10(C)! 2 

L 2^-*ir<K|<2^ 


1/2 


J 紅 WWI 2 


1/2 


The second factor is finite becaose^is <xmipactly suj^orted and in L 2 (R)； 
the first factor is bounded by CA J , with [Af < 1, as shown above. Thk 
establishes (8.3,16)，which is also equivalent to 

s«p J2 < <» - 


• Finally, a combination of the Poisson summation formula and the C&uchy- 
Schwara inequality leads to 

E K/^m)I 2 <2ir/dC \h0\ 2 1^(2^)!^ E I 砂卜 2腿)|咐 J) • 

It therefore follows from (8.3.15) and (8.3.10) that 
£|{/,^)I 3 <^J|/# 2 . * 

iM 


Fbr more details concerning this argument} see Cohen and Daubechies (1992). 
In order to ensure that we have indeed two dual Riesz bases of wavelets, we 
therefore only have to check that 1 is a noi»tegenerate eigeavalue of i^,P 0 and 
that the corresponding trigonometric polynomieJ is strictly positive. 
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Regularity and vanishing momrats. If the 味从 ， conrtitute 
» bases (of compactly supported wavelets, since ^re have assumed the 
be FIR), then w can apply Theorem 5.5.1 to fink vanishing moments 
unction with regularity for the other: if ^ € <7™, then automati- 


8.3.3. Regularil 
dual Riera bases (c 
filters to be FIR)，1 
of one function w 

catty f dx x 1 雀 (x) 


0, ... ， m. 


catty f dx x 1 雀 (x) = 0 ^ = 0, • ■ •, m,° This is equivoleiit with — 0 

for ^ Because of (8.3.9) and 0(0) = 1, tb»-impHes 杀兩 

for Z =s= 0,… ， m. By (8.3.10) this Implies that mo is divisible by ((1 + e~^)/2) m . 
In order to produce regular we therefore need to construet filter pairs mo, mo 
sudi that mo(0 has a multipie zero At it. 

Note that nothing prevents ^ and ^ from having very ^ffetent regvdarity 
properties, as illustrated by some of the examples below. If ^ is mudi more 
regular than 妒 ， corresponding to many more vanishing moments for ^ than for 
必 ， then the two foramlas 、 


and ^ from having very Afferent regvdarity 
of the examples below. If ^ is mudb more 
aany more vanishing moments for # than for 


E </，知 

i，* 

^ (f 、 i’i ， k) 妁 , k 


(8,3.17) 


(8.3,1B) 


both equally valid, have very different interpretations (Tchamitchian (1987)). In 
practice, (8.3.17) is much more useful than (8.3.18 )： on the c»ie hand, the largie 
number of vanishing moments of ^ leads to much more u compression potential" 
in the regions where / is reasonably smooth (see §7.4); on the other hand, the 
“elementary building blocks” are smoother. In Antonini et al. (1990) m 
experiment was carried out with biorthogonal wavelets of this type: the same 
filter pair was used twice, the second time with roles of ctocom|>osition and re¬ 
construction filters exchanged. The case corresponding to (8.3*17) gave rise to 
much better results after quantization than (8.3.18). As we already mentioned 
in §7.4 t it is oot clear whether the high number of vani^iing moments of 垆 or 
the regularity of ^ is the most important factor; it is po6»ble that they are both 
important. 


8*3.4. Syminetry. One advantage of biorthogonal over orthanormai bases 
is that mo, rho can both be symmetric. If the filter correspcmding to mo has an 
odH niimhM* of tAtvi. And is flvmniAtnfr. Le. 之)， then TTIq 


odd number of taps, and is symmetric, i.e. mo(-0 = 
be writt^i as 

moK) = Po(coeO ， 


(8.3.19) 



(8.3*21) 
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we then have indeed 

mod) ^(0 + moU + ir) - 1, (8.3.22) 

which is the same as (8.3.5). Polynomials po solving (8.3.21) can only be found 
if po( 2 ：) and po(—x) have no common zeros; once this is the case，there always 
extet solutions by Bezout's theorem (see §6.1). Note that this also means that 
biortfa<^<Hial bases are much easier to construct than orthonormal bases: we 
need to tolve only linear equations to find ptj satafymg (8 么 21> once po is fixed, 
instead otthe spectra) factorization needed in §6.1. 



m(0 = e***€-^ 3 MB! po 一 《)• (8-3.23) 

One can then again choose mo of the same type, 


mo(0 = e -»*« 2 cos| Ai(coB^); (8.3.24) 

equation (8.3.22) becomes 

coe 2 1 po(coe^) po(coeO + »n J | po(-cosC) Sf-coeC) = 1 > 
whidi means that po solves the Bezout problem 

Po( x )PoM + pf(-z) po(~a:j = 1 ， 
with pf(x) = ^ po(x). 


Examples. All the examples we give here have both symmetry and some 
regularity. The trigonometric polynomials mo and mo are th 咖 fore of type 
(8.3.19), (8,3.20) or (8.3.23), (8.3.24), with po(cobO, divisible by 

(1 + e^Y 
£ will aut 
Consequent 


or wii>a po\vuBi；f aivisioie uy 

Hue / > 0. Since we are deaUng with polynomials in cos^, 
Uy be even; (1 + e-«) 3 = 4e — 鋒 coe 3 ! 篇 2c^(l+<x»0 
are looking for mo, mo of type 


如 (cosfl 


H) 

if they have an even number of taps (we have assumed 
hn^knBm symmetric around 0), or of type 

Hr 


that k^Oy i.e., that the 


「姒 2 


QoleosO 


if the hi _ 
hi—n ~ 


■ of taps is odd (again we have taken ib : 0 ， 

- n = /in)- In both cases, substitution into (8.3.22) 崧 ves 


(cos I) «,(coBflWoosO + (sin 0 9o( - coeO«,(-coefl = 1, (8.3.25) 
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pith L ss £ + 1 in the first case, L — ^+ 1 in the second case. If we define 

ffo(coB^) 如 (cos《) =P (sin 2 !)， then (S.3.25) reduces to 


(1 - x) L P{x) + x L P(\ - a:) ^ 1 , 


(8.3.26) 


an equation we already encountered in § 6 . 1 . The solutions to (8.3.26) are all 
given by 

p(x) = r 1 ( L - l ^ m ) ^ + x^Rd-2x), 


m 


where iZ is aa odd 
Families of examples, 
of P into 如 and 知 . 


polynomial (see Proposition 6.1.2). We now present three 
,based on different choices for R and different factorizations 


Spline examples. Here we take i? s 0， and 如 s 1 . It follows that 
rho (0 = (cos I) 片 ， N = 2 /， or 命 q( 《） =e —" 2 (cos |) 汾 ， /V = 2 / + 1 , so that 
0 is a B-spline centered around 0, respectively 5 . In the firet case, we then have’ 
with N = 2£, 

⑽ r，) (-1)'. 

in the second case, with N 2 ^+ 1 , 

mo(« = e~^ (cos|) W g ( # + 1 +， ") - 


In both cases we can choose/ freely, subject to the constraint that the eigenvalue 
1 of Po is nondegene^ate and that the associated eigenvector oorresponds to a 
strictly positive trigonometric polynomial (see §8.4.2). The result is & family of 
biorthogonal b^ses in which V is a spline function of compact support; for every 
preassigned order of this spline function (i.e., fixed £), there exists an infinity 
of choices for t t correspondmg to different ^ (with increasing support widths) 
and different with increasing number of vanishing moments. Note that 4> is 
completely fixed by N alone, while mo, hence 0 depends on both N } N. We have 
plotted the functions ^ 0 , 片， w 摹，片 , " 少 ， and 段， N 呤 ， the first few values of 
N,N t in Figures 8.5-8J (iV ^ 1 in Figure 8.5, N = 2in Figure 8 . 6 , JV = 3 in 
Figure 8-7); the corresponding filters are given in Table 8 . 2 . In all these cases, 
the conations derived in §8.4.2 are satisfied. A striking feature in Figures 8.5- 
8.7 is that from some point on, increasing N (for fixed N) does not alter the 
shape of 汾 , N +\ one sees the M wririkle 8 w in the corresponding and ^ N i/> 
get ironed out as AT increases. 
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The functions 1 , 3 ^ and 13 0 were first constructed in Tchamitchian (1987) 
as an example of two dual wavelet bases with very different regularity prop¬ 
erties. Here they constitute the firat non-orthonormal example of the family 
(N — l = N gives the Haar basis). As in the orthonormal case, arbitrarily 
high regularity can be attained with these examples, for both if; and As a 
spline function, ^ N i> is piecewise polynomial of degree N — l and is C N ~ 2 
at the knots; the regularity of can be assessed with any of the tech¬ 
niques in Chapter 7. Asymptotically，for large N t one finds that € C m 

if TV > 4.165 A + 5.165 (m + 1 ). These spline examples have several remarkable 
features. For one thing, all the filter coefficients axe dyadic rationals; since divi¬ 
sion by 2 can be done very fast on a computer v this makes them very suitable for 
fast computations. Another attractive property is that the functions ^ N ^>(x) 
are known exactly and explicitly for all x, unlike the orthonormal compactly 
supported wavelets we saw before . 11 One disadvantage they have is that mo and 
rho are very unequal in length, as is apparent from Table 8.2. This is reflected in 
very different support widths for <j> and because they are determined by both 
mo and mo, ip and always have the same support width, given by the average 
of the filter lengths of mo, mo, minus 1. The large difference in filter lengths for 
m 0 , mo can be a nuisance in some applications^ such as image analysis. 

Examples with less disparate filter lengths. Even if we still take R = 0 t it 
is possible to find mo and mo with closer filter lengths by choosing an appropriate 
factorization of 尸 (sin 2 |) into 如 (cos《）and 如 (cosf). Fbr fixed £ + £ there is 
a limited number of factorizations. One way to find them is to use spectral 
factorization again: we determine all the zeros (real and pairs of conjugated 
complex zeros) of P, so that we can write this polynomial as a product of real 
first and second order polynomials. 


P (x ) 二 JJ(x 2 - 2 Rez,i -}- |^ t | 2 ). 

Regrouping of these factor leads to all the possibilities for go and %. Table 8.3 
gives the coefficients for mo, mo for three examples of this kind, for /+/ = 4 and 
5. (Note that £ + £ = ^13 the smallest value for which a non-trivial factorization 
of this type is possible, with %, qo both real.) For ^ ^ = 4, the factorization 

is unique, for ^ ^ = 5 there are two possibilities. In both cases we have chosen 

so as to make the length difference of mo, mo as small as possible. The' 
corresponding wavelets and scaling functions are given in Figures S .8 and 8.9. 
In all cases the conditions of §8.4.2 are satisfied. 

8.3.5. , Biorthogonal bases close to an orthonormal basis. This first 
example of this f^anily was suggested by M. Barlaud, whose research group in 
vision analysis tried out the filters in § 6 A t 6 B for image coding (see Antonini et 
al. (1990)). Because of the popularity of the Laplacian pyramid scheme (Burt 
and Adelson (1983)), Barlaud wondered whether dual systems of wavelets could 
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Table 8.3 

The coefficients of mo, mo for three auea of ^ariaticns on the spline case” mth filters of 
a%mUar length, corresponding (o # -f / = 4 and 5 (see text). For each filter we have also gtven 
the number o/(cos^/2) factors (denoted N,N). As in Table 8.2, multiplying the entries below 
with y/2 gives the filter coefficients hn,hn. 


N、fi 

n 

coeffideat of 
e-W in mo 

coefficient of 
e - ㈣ in ifiQ 

N = 4 
N = 4 

m 

■ 

.557543526229 

.295^5881557 

-.028771763114 

-.045635881557 

0 

.60294^018236 

.266864118443 

-.078223266529 

-.016864118443 

.026748757411 

1 

■ 

团 

.636046869922 

.337150822538 

-.066117805605 

-.096666153049 

-.001905629356 

.009515330511 

.520897409718 

.244379838485 

-.038511714155 

.005620161515 

.028063009296 

0 

N = 5 
N = 5 

0 

1’ _1 
2,-2 

3, _3 

4, 一 4 

5, -5 

.382638624101 

.242786343133 

.043244142922 

.000197904543 

.015436545027 

.007015752324 

.938348578330 

.333745161515 

-.257235611210 

-.083745161515 

.038061322045 

0 






Fig. 8.8. The functions V* corresponding to the case N — 4 = N in Table 8.3. 








0 2 


♦、去、呤 、令 


symmetry for compactly supported wavelet bases 281 


be constructed, using the Laplacian pyramid filter as either mo or mo. These 
filters are given explicitly by 

-ae -狄 + .25e~ l€ + (.5 + 2o) + .25^ - oc 2 ^ . 和 .3‘27) 

Fbr a = -1/16, this reduces to the qpll&e filter 4 ma as described under the 
“spline examples” above. For applicatione is vision, choice a = .05 is es¬ 
pecially popular even though the corresponding 不 has less r^ulMnty than 4 表 
it seems to lead to results that are better from the point of view of visual per¬ 
ception. Following Bar laud's suggestion, we chose therefore a — .05 in (8.3.27), 
or 



mo(C) ― .6 + .5 cos ( — .1 cos 2^ 

1 + 尝 sin 2 I) . (8.3.28) 

5 2 / 

Candidates for mo dual to this mo have to satisfy 

mo(C) ^»o(4) + mo (《 +ir) ^o(C + ?r) = 1. 

As shown in §8.4.4, such mo can be chosen to be symmetric (since mo is sym¬ 
metric); we also opt for 7710 divisible by (cos (/2) 2 (so that the corresponding 
i/f, \j> both have two zero moments). In other wwds, 「 

TT*o(0 = (cos 0 P(rin 2 !) ， 

where 

(1 —af (1 + P(:r) + ar 3 (| — |x) / >(1-*) = 1. 

By Theorem 6.1.1, together with the symmetiy tit this equation for substitution 
of a: by 1 - x, this equation has a unique solotiQii P of degree 2, which is easily 
found to be + 

P ( z ) = 1 + 5* - . 

This leads to 





(^f) OK- | 8 in 4 纂） （8 . 3 . 29 ) 

- ^ • (咧 


One can chedc that both (8.3.28) and (8.3.29) satisfy all the conditions in §8.4.2. 
It follows that these mo and mo do indeed correspond to & pair of biorthogonal 
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wavelet bases. Figure 8.10 shows graphs of the corresponding <f>, 0, and \j). 
All four functions are continuous £>ut not differentiable. It is very striking how 
similar 4> and 4> are, or tp and This can be traced back to a similarity of 
mo ahd rho, which is not immediately obvious from (8.3.2f) and (8.3.30), but 
becomes apparent by comparison of the explicit numeric^ values of the filter 
coefficients, as in Table 8.4. In both filters are very cl(X3e to the (necessarily 
nonsymmetric) filter corresponding to one of the orthonormal coifiets (see §8.3), 
which we list again, for comparison, in the third columa in liable 8.4. This 
proximity of mo to an orthonormal wavelet filter explains why the mo dual 
to mo is so close to mo itself. A first application to inu^e analysis of these 
biorthogonal bases associated to the Laptacian pyramid is giveii in Antonini et 
al. (1990)r 



-2 0 2 -2 -1 0 1 2 3 



0 2 -2-10123 


Fig 8.10. Graphs of ♦ 、伞 ，蚤、必 far the btorthogorud pair constructed from the Burt- 
Adelaon low-pass filter. 


M. Barlaud’s suggestion led to the accidental discovery that the Burt filter is 
very close to an orthonormal wavelet fitter. (One wond^s whether tlus closeness 
makes the filter so effective in applications?) This example suggested that maybe 
other biorthogonal bases, with symmetric filters and rational filter coefficients, 
can be constructed by approximating and ** 871111116111210 ^ existing orthonormal 
wavelet filters, and computing the cxtffespondmg dual filter. The coiflet coeffi¬ 
cients listed'in §8.3 were obtained via & construction method that naturally led 
to close to symmetric filters; it is natural, thei^fore, to expect that symmetric 
biorthogonal filters close to an orthonormal balis will in fact be dose to these 



SYMMETRY FOR COMPACTLY SUPPORTED WAVELET BASB8 


283 


Table 8.4 

Ftltv - coefficxenU for (mo)Burt, for the duat fiUer (mo)8urt computed m ihu aectton, and for 
a «eiy close filter (mo) col fl et corresponding to an orihonorrtud basis of cotftctt («ee the enirtes 
for h = I tn Table 8 1) 


n 

( 饥 0) Burt 

(mo) Burt 

(iTlo)coifiet 

-3 

0 . 

-.010714285714 

0 . 

-2 

-.05 

一 053571428571 

-.051429728471 

-1 

.25 

.260714285714 

.238929728471 

0 

6 

.607142857143 

.602859456942 

1 

.25 

260714285714 

.272146543058 

2 

-.05 

-.0535714JS8571 

-.051429972847 

3 

o. 

-.010714285714 

-.011070271 咖 


coiflet bases. The analysis in §8.3 suggests, therefore, 

roo(0 = (cos H2f K 5^ ( A — d (sin i/2) 2k + 0((sin 《 /2 严 ) 
■fe:i \ / 

In the examples below we have chosen in particular 


mo(C = (cos (/ 2 严 


E (H — w 严 “— m 2K 


and we have then followed the following procedure: 

1 Find a such that [1 - Jmo(^)| 2 - |mo(^ + »)| 2 }| is minimal (zero In 

the examples below). This optimization criterium can of course be replaced 
by other criteria (e.g. r least sum of squares all the Fourier coefficients of 
1 - |mo(0( 2 - |77io(C + 7r)t a instead of only the coefficient of e*^ with 
£ ― 0). For the cases K = 1,2, S, the smallest root for a ia .861001748086, 
3.328450120793, 13.113494845221, respee^vety. 

2. Replace this (irrational) “optimal” v^ue for a by a close value expressible 
as a ample fraction. 12 For our examples <i = .8 « 4/5 was dtoeen tot 
if « 1, a = 3.2 = 16/5 for K = 2 a *= 13 for = 3. For JiT = 1, this 
reduces then to the example above. 


3> Since mo is now fixed, we can compute mo. If we require that mo be also 
cfivisible by (cos (/2) 2 ' then 

^(0 = (c^fl P K ((rnn e/2) 2 ) , (8.3.31) 

where Pjt & a polynomial of degree 3K — 1. The same analysis as In 
Daubechies (1990) ahcme that 


Pk(x) = (瓦 + °( xK ) * 

**o 、 / , 
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thereby determining already K of the 3K coefficients of P/c- The others 
can be computed easily. For K — 2 and 3 we find 

Pi(x ) - 

P^(x) =* 

In Table S.5 we li^; the explicit numerical values of the filter coefficients for tio, 
mo and the closest coifiet, for /if = 2 and 3. We have graphed 多，多，矽 ， aed 
for both cases in Figure 8.11. It is worthwhile to note that the computation of 
the biortbogonal filters mo, mo, as explained fay the above procedure, is ouch 
simpler than the computation in Daubecbies (1990) of the orthonormal coiflet 
filters! This illustrates the greater flexibility of the construction of biortbogonal 
wavelet bases versus orthonormal wavelet bases. 

Table 8.5 

Numeriad values for the JUUn mp, mg for biorihogonat ba$et to coiftets, for the cases ) 
if =s 2 and 3 (see text). The third column lists the coefficients of the orihonormol ooifUt fitter 
to which mo and mo are very close. In order to compare the different eoefficienit more easily, 
ive have expressed everything in decinud notation; in fact, ihe coeffictenti of mo and mo are 
tntional. 


-f 2x + ~X^ + 8x^ 
0 




1 + 3x + ftc 2 + 7i 3 + 30i 4 + 42ar 5 


1921766 


of 


.575 
.28125 
_ .05 
-.03125 
.0125 

0 

0 

6 


.5634765625 
.29296875 
- .047607421875 
-.048828125 


.005859375 

-.003173828125 


of mo 


.575291895604 

.286392513736 

.052305116758 

.0397235^7092 

.015925480769 

.003837568681 

.001266311813 

.00050^24725 


.560116167736 

.296144908701 

.047005100329 

.055220135661 

.021983637555 

.010536373594 

.005725661541 

.001774953991 


.574682393857 


.273021U46535 
.047639590310 一 
.029320137980 - 

.011587596739 


.561285256S70 


.286503335274 
.043220763560 
.046507764479 
.01 

.005503126709 

.002682418671 


294867193696 

054085607092 

042026480461 

016744410163 

003967883613 


001289203356 

000509505399 


302983571773 

060770140755 

0581962&0762 


011229240962 
006369601011 
001820458916 
000790205101 
000329665174 
000050192775 
734 
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Notes. 

1 . In the sense that the — n) are orthonormal, as are the tf >2 {- -* n). 

2. Strictly speaking, Lemma 6.2.2 only proves support ⑷ C [0, N]. A re¬ 
cent paper by Lemaiie and Malgouyres (1991) shows that support ( 必 ） is 
necessarily an interval, which in this case then has to be [0, iV], 

3 ， Nevertheless, AWARE, Inc. us«3 the asymmetric filters from §6.4 with ex¬ 
cellent results in image and video coding. Note ala> that **perceptuaily” 
small or large errors are difficult to quantify mathematically; the norm 
most often used to measure “distance” is the ^-norm, but that is.niore 
because this is the easiest norm to handle than for any other reason. All 
experts agr 抚 that the / 2 -norm is not a good candidate for a “perceptual” 
norm, but as far as I know, there is no agreement on a better candidate. 

4. The N<f> from §6.4 do not have this property. The graph of | is very 

flat near ^ = 0, showing that ^ | jv^lj = 0 for £ = 1 ■ * but the 

phase of does not share this property. 

5. The proof that 2o is a bounded operator is easy ： if support 4> = [—iVjjiVa], 
then 




dx f(x) <f>(x - k) 


fN^-k \ 1/2 

L - 严叫 _ 2 


(by Cauchy-Schwarz); 


hence 


< m 2 (^ 2 +^)||/|| 2 . 


Similarly, one proves that ail the Tj 

6 . We have 


bounded. 


li/ll: 


忠 K/ ，心& 




EE 




^ IS i(/t^)i 2 ),(X) 
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^ 忠疼1(/’ 〜 >1” _ 2 

< A \(f^j,t)\ 2 • 

7. The angle between two subspaces is defined as the minimum angle between 
elements, 

angle (E, F) = inf cos -1 . 

«ee ，/ € f |N| ||/!| - 

8 . The proof in Cohen, Daubechies, and Feauveau (1992) imposes a much 

stronger decay condition on 4>, n 咖 dy j^(C)l < C(1 4 - (which is 

known not to be satisfied in even some orthononnai cases) in order to derive 
(8.3.15) and (8.3.16). The argument sketched here comes from Cohen and 
Daubechies (1992). 

9. The derivatives £ = 0 - -m, are automatically bounded because ^ has 
compact support. 

10 . In the case N — 2 = N, a. curious phenomenon happens. The function 
2,2 小 ， although an element of i 2 ^[-2,2]) (hence also of X 1 ([-2,2]) I has 
in fact a singularity at every dyadic rational. The true graph of 2,2 沴 (o〆 
2,2V 7 ) would therefore consist of a black rectangle (since our lines have some 
thickness), but the graph in Fig. 8.6 is nevertheless a close approximation 
in L 2 or L 1 , although not in L°°. I would like to thank Win Sweldens for 
pointing this out to me. 

11 . Auscher (1989) and Chui and Wang (1991) contain another construction 
of non-orthonormal wavelet bases where one of the two wavelets, say 矽 ， is 
a compactly supported spline function, and is therefore also known exactly 
and expMciily everywhere. In this ccmstructkm the -spaces are orthogo¬ 
nal, unlike here, and W 3 = Wj. As a result, the dual wavelet xj) has infinite 
support (compact support for both 妒’必 can only be achieved by giving up 
the orthogonality of the Wj), with exf>otiential decay. The associated mul¬ 
tiresolution analysis is the same as 4ot the B^tle-liemarie wavelets; ^ is 
chosen so that it is orthogonal to the B-spline of the right order and all its 

integer translates, and ip is then given by 必 ( 《） = 摹 ⑹ /Efc |^K + 2?rfe)|% 

12. Choosing a rational leads to mo, mo with rational coefficients. Note that 
there is nothing sacred about the original irrational values of a ： changiiig 
criterion in point 1 will lead to lightly difierent values of a. 



CHAPTER 9 _ 

Characterization of Functional 
Spaces by Means of Wavelets 


The major message of this chapter is that tbe orthonormal bases we have dis¬ 
cussed for the last four chapters also ©ve good (i.e. ， unconditional) bases for 
many other spaces than L 2 , out-performing the Fourier basis functions in this 
respect. Almost ^1 the material in this ch^teris borrowed from Meyer (1990), 
but it is here presented in (I believe) a more pedestrian way, accessible to readers 
with a lower level of mathematical sophistication. (Meyer’s book also contains 
much more on this subject than is explained in this chapter*) In §9.11 start by 
reviewing a classic theorem of pure harmonic analysis^ the Caider6n-Zygraund 
decomposition. It can be found ateo in many textbooks (such aa Stein (1970)); 
I include a detaUed proof here as an iUustratkm of techniques using different 
(dyadic) scales，practiced in pure harmonic analysis long before wavelets came 
along. Together with some other classic theorems, it leads to the proof that 
wavelets are an unconditional bases for 1 < p < oo. Section 9.2 lists 
the characterizations, Jby means of wavelets, of other hinctional spaces, with¬ 
out proof. Also included is a short discussion on ths detection of singularities 
with orthonormal wavelet bases. Section 9.3 treats expansions of £r l -functions 
by means of wavelets; since L 1 has no unconditlcMiat ba^s’ wavelets cannot do 
the impossible, but they still do a better job than .Bburier expansions. Finely, 
§9.4 points out an amusing difference in emphasis between wavelet and Fourier 
expansions. 

' - 

9.1. Wavelets: Unconditional bases for 1 < p < oo. 

We start by proving the Calder6n-Zyjgjau^d decomposition theorem. 

Theorem 9.1.1. Suppose f i» a po$ii»ie fimction in JLr^R). Fti a > 0. 
Then R can be decomposed as follows: 

1. R = GUS t with GOB = 0* 

2. On the “good” act Cl ， f(x) < a a.e. 

3. Tht tt bad n set B can be written as 

B = U Qk, v^iert the Qk art non-overlapping intervals, 
k€fi 


389 
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and a < lQjfe| _1 / dx f(x) < 2q, for alt k . 

Proof. 

1. Choose L = 2^50 that t~ l dx f(x) < a. It follows that 

L~ l fkL +l ^ L ^ fi x ) < a for all fc € Z. This defines a first partition 
of R. * 

t 

2. Take a fixed interval Q — [fcL, (k-^ l)L[ in this firat partition. Split it into 
two halves, [kL r (k + \)L\ and [(A + j)L, (A: + 1)L[, Take either of the 
halves, call it Q*, and compute Jq/ = IQ1 -1 Jq^ /(x). If 1q> > a, then 
put Q in the bag of intervals that will mate up B. We have indeed 

a <I Q >< \QT l f dx f(x) = 2IQI" 1 f dx f(x) < 2a . 

Jq Jq 

If 1q> < a; keep going (split into halves, etc.), if necessary, ad infinitum. 
Do the same for the other half of Q t and also for aU the other intervals 
[ 允 L，(fc + 1)L[. At the end we have a countable bag of “bad” intervals 
which all satisfy (9.1.1); call their union B ^nd the complement set G. 

3. By the construction of B, we find that for any x B, there exists an 
infinite sequence of smaller and smaller interv^s Q\,Q2^Qzr'' so that 
x^Q n for every n, and \Q n \^ 1 J Qn dy f{y) < a. In fact, = \\Qj-\\ 

for every j, and Qj C Qj-i- Because tbe Q n “shrink to” 

* 、 

队广 1 / 办 f{p) — ► /(:) almoet surely . 
hn 

Since the left Bide is < a by construction, it follows that f(x) < a a.e. 
in C7. • ' 

Note that the choice L — 2 1 implies that ail the intervals occurring in this proof 
are automatically dyadic intervals, i.e., of the form [fc2 一 ' (fc + 1)2~^[ fo*- some 
k,j e Z. 

Next we define Calder6n~Zygnmnd operators and prove a classical property. 
Definition . 1 A CaUterdn-Zygmund operator T onU is an integral operator 

(Tf)(x) = I dy K(x } y) f{y) . (9.1.1) 

for which the integral kernel satisfies 

\K{xM < , * ( 9 - 1 . 2 ) 

1 跑 y) +||； ^)|<]^* (_ 

and which defines a bounded operator on L 2 (R). 
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Theorem 9.1.2. A Calderon-Zygmund operator is also a bounded operator 
from L J (R) to L^fR). 

The space in this theorem is defined as follows. 

Definition. /€ ^^(R) if there exists C>Q so that, for a// a > 0, 

{x; |/(x)|>a}|< (9.1.4) 

The infinum of all C for which (9.1.4) holds (for all a > 0) is sometimes 
cal ㈣ BU 

Examples. 

1. If / 6 //HR), then (91.4) is automatically satisfied. Indeed, if 

{x\ \f(x)\ > a}, then 

a \S Q \<J s dx\f(x)\< J^dx\f(x)\ = ||/|| L1 : 

hence 

Wfh^ < B/lb . 

2. f(x) = |jc|— 1 is in since |{x; |x| _1 > a}| - 盖 . However, 

/(x) ― \x\~^ is not in if 冷 > 1- 

The name is justified by these examples: extends L l , and contains 

the functions / for which / 1/| “just” misses to be finite because of logarithmic 
singularities in the primitive of |/|. T 

We are now ready for the proof of the theorem. ' 


Proof of Theorem 9.1.2. 


1. We want to estimate |{x; \Tf(x)\ > a}|. We start by making a Calderdn- 
Zygmund decomposition of R for the fimcticm |/|, with threshold a. Define 


& (x)= 


/(:) 



if xeG, 

if x e interior of Qk , 


0 if xGG t 

f(x) - \Qk\~ l f dy f(y) if xe interior of Q k . 
JQh 


Then /(x) = g(x) + b(x) a_e.; hence Tf = Tg + Tb. It follows that 
|T/(ar)| > a is only possible if either |T^(a?)| > a/2 or |T6(a:)| > a/2 (or 
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both); consequently, 

l {^； \Tf(x)\^a}\ (9.1.5) 

<({*； l^)l>f}| + |{x ； |TMx)|>|}|. 

The theorem will therefore be proved if each of the terms in the rig^-hand 
side of (9.1.5) is bounded by § ||/H L ». 


2. We have 

(f )> 


|^(x)|>|}|< I dx |Tp(x)| 2 
{*; ir,(«)i>f} 

<(^ l^(x)| 2 = liT^jli ， < C\\gf L ,, 


(9.1.6) 


because I 1 is a bounded o{>erator on L 2 . Moreover, 

llpllia = f 虹 1 p(x )| 2 + f dx |p(a:)|®- 
Jg Jb 

(use tbe defi&iticm of g t and \f(x)\ < a on G) 

, ~ a 1’ ⑻ I + 12 2a J Q dy 1’ ⑹ I 

(uselQkr 1 f dv |/(y)| < 2a) 

Jqi. 

< 2a j^dx\f(x)\ = 2 a \\f\\^ . 

Ccnnbining this with (9.1.6), wc obtain 

|{®； |^)1>|}|<^||/!|^. (9.1.7) 

3. We now concentrate on b. For eadi k t we define new intervals Q* by 
Stretching^ the Qk ： haB the same center as Qk, but twice its length. 

We define then B* = UjfcQJ, and G* = R\B*. Now 

ib*i < Y 1 i«i = 2 E ^ 

k k 

(because IQfcl" 1 J dx |/(*)1 > a) 


II/IIl* , 



so that 
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. ( 9 . 1 . 8 ) 

4. It remains to estimate |{x € G*\ )7^(*)| > |}|. We have 

f |{xW; |^)|>|}| < I dx \Tb( X )\ 

< f dx |T6(af)| . (9.1.9) 

Jg. 

5. To estimate this last integral, wt aepaiate the different contributions to b. 
Define bk{x) by 




0 if xf^Qk y 

f(x) ~ f dy f(y) if x € interior of Q k 


Then b(x) — 6jt(i) a.e” since the Qk do not overlap. Consequently, 
Tb = and 

> * 

J G dx\Tkx)\ < 11 j Q ^ l r6fc ( x )I ^ ^ lTbk{x)l 

- Yl Xw ^ \Iq dy bk ⑹ 

=E / ^ 1/ d vmx,y) - K(x,y k )\ b h (y) 

k \JQm 

(yk is the center of Qk ； we can insert this 
extra term because Jg h dy bk(y) = 0) 

< E / 缸 f dy\K(x,y)-K(x,y k )\ |6 fc (y)| . 

(9.1.10) 

The difference K{x t y) - K(x t yk) can be estimated by using the bound on 
the partial derivative dzK of K with respect to its second variable ： 


^l\Q ； 

< 

< 


dx \K(x,y) - K(x y yk)\ 

乂 dx j^dt \daK (: t ， y k + t(y - yk))\-\y-Vk\ 


^-Vk\^Rk 


缸 j 。ctt C\y - y h \ |(* - y k ) - t(y - yit)!' 
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(where we write Q k = \y k - Rk, Vk + 丑 Jt[， 

Qk ~ [Vk ~ 2i2jt, yk + 2iijfc[) 

=M f ^ f dt ~^ T C 2 

J\u\>2 JO 增 — 如 | 2 
(after the substitution x = y k ~t iljtu, y — yk-+ RkV, 
where ju| > 2, }t；| < 1) 

< C' (independent of k). 


Substituting this into (9,1.10) yields 


j G dx\Tb{x)\ < 
< 

， < 


\b k (y)\ 

2cr J2 f d y l/Wl <ll/li^ - 


Together with (9.1.7)，（9 1.8), and (9.1.9)，this proves the theorem. ■ 


Once we know that T maps L 2 to L 2 and L 1 to we can extend T to 

other L^-spaces by interpolation theorem of Marcinkiewicz. 

Theorem 9.1.3. If an operator T satisfies 

\\Tfh^ k < ll/IU,, , (9.1.11) 

r/||^ k < C7 2 |t/|fL，a , (9.1.12) 

where qi<Pi,q 2 <P 2 , then for | 念 = ^ + mth0<t< 1, 

there exists a ctmstant K, depending on Pi^i,P 2 > 92 » and t y so that 

lir/!U ， < k li/tu，. 

Here ljr eak stands for the space of all functions / for which 
ll/IU^ k = M {C; |{x; |/(x)|>a}|<Ca-« for all a > 0 } 广 
is finite. 

This theorem is remarkable in that it only needs ^%aker bounds at the 
two extrema, and nevertheless derive bounds cn L 9 -nonns (not Z/J^) for in¬ 
termediate values q_ 3 The proof of this theorem is outside the scope of this 

chapter; a proof of a more general version car be found in Stein and Weiss 

(1971). The Marcinlfiewicz interpolation theorem implies that the L 1 -* Lj^- 
boundedness proved in Theorem 9.1.2 is sufficient to derive boundedness 

for 1 < p < oo t a3 follows. 
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Theorem 9.1.4. IfT is an integral operator with integral kernel K satisfying 
(9.1.2) and (9.1.3), and ifTis bounded from L 2 (R) to L 2 (R), then T extends to 
a bounded operator from ^(R) to /^(R) for all p with l < p < ob. 


Proof, * 

1. Theorem 9.1.2 proves that T is bounded from L 1 to by 

Marcinkiewicz , theorem, T extends to a bounded operator from IP to I/' * 
for 1 < p < 2. ， 

2. For the range 2 < p < <x>, we use the adjoint T of T, defined by 

j dx (f /)(i) g{x) ^ J dx f{x) (Tg)(x). 

It is associated to the integral kernel K{x^y) — K{y, a:), which also satis¬ 
fies the conditions (9.1.2) and (9.1^). On L 2 (R), it is exactly the adjoint 
in L 2 -sense T*^ so that it is bounded. It follows then from Theorem 9.1.2 
that f is bounded from L 1 to Li, eak , and hence by Theorem 9.1.3, that it 
is bounded from L 7 * to for 1 < p < 2. Since for 会 + 參 = 1， T : LP—^U 3 
is the adjoint of T : L q -*L q t it follows that T*is bounefed for 2 < q < cx>. 
More explicitly, for readers unfamiliar with adjoints on Banach spaces, 


r/iu 


< 


sup 

O^LP 


sup 

9€LP 


sup 

g^LP 



dx{Tf){x)W) (if 卜卜 1 ) 
jy* dx J dy f{y) K(x,y)g{x) 

^dy fiy) {Tg)(y) 
ll/IU* IITpIUp < C lt/!U，• 


(Strictly speaking, changing the order of integrations in the third equality 
is not allowed for all f,g, but we can restrict to a dense subspace where 
there is no such problem.) ■ ' 


We can now apply this to prove that if 0 has some decay and some regularity 
and if the = 2 ~^ 2 少 (2~h - k) constitute an orthonormal basis for 

L 2 (R), then the 办 also provide unconditional bases for /^(R )， 1 < p < oo. 
What we need to prove (see Preliminaries) is that if 

/ = X] €LP » 
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then 

X] C J> ^3,k € LP 

j，* 

\ 

for any choice of the uj Jt k — ±1. 

We will assume that ip is continuously differentiable, and that both ^ &nd ^ 
decay faster than (1 + lil )* 1 ： 

!^(x)! ， W(x)\ < C(l + Ixir 1 - . (9.1.13) 

Then ^ e L p for 1 < p < oo, and / = c S,t^k implies c),* : 
J dxf(x) jp Jt k(x) f because of the orthonorm&Uty of the We therefore want 
to show that, for any choice of the u> Jt k = ±1, T v defined by 

r w / = [ % fc </，％,*) , 

j,* 

is a bounded operator from to We already know that is bounded from 
L 2 to L 2 , since 

fi^/iii 3 = !>#</，^)\ 2 - £i</ ， ^,*)I 3 - il/tl 2 , 

j.* j,* 


so the I^-boundedness will follow by Theorem 9.1.3 if we can prove that is 
an integral operator with kernel satisfying (9.1.2), (9.1.3). This is the content of 
the following lemma. 


Lemma 9.1.5. _ 

Choose uj Jtk = 土 1, and define K(x y y) *= Then 

exists C <oo to that 




dy 


K{x,y) 


C 


|i ll 2 


Proof. 

1. 

t^(ar,y)| < X)Ka ； )IK*(y)| 

< CYj 2 -i (l +12-^ - 句 )- 1 -*" + \2^y~ k\y l ~ e 

(by (9.1.13)). 


Find jo € Z so that 2*» < (at - y| < 2* +l . We split the sum over j into 
two parts: j < jo and j > jo- 
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2. Since E fc (l + {a - A|)~ 1_e (l -f |^ — 纠广 1_ * is uniformly bounded for &U 
values of a, 6, 4 we have ' 

]£ 23 + |2^ar- fc|)-^*(l + |2^y - *|) 〜 

j^jo k 


<C± 2 ^<C 2 ^<^. 


3. The part j < 加鉍 a little less easy, 
io-i 

E 2 ' j E^ 1 + 12 -心 - *1)(1 + r j y- fc|)]- 1 -' 

j 苗一 oo k v 

- f ； y ^ 1(1 + - * ： D(1 + 的 - 嘗 h 

户一 io+i k ， 

< 2 1+< ^ E [(2 + | 2 ^c — Jb |)(2 + |yy 二 Jt|)]' 1 ^ . ( 9 . 1 . 14 ) 

Find ibo € Z so that ko < < &o.+ I, and define ^ = fc - Aq. Then 

2 + \^ x-k\ « -2 + y — 

> 1 + 

similarly, f 

2 + - 

Cooseqiwntly, with a » 

X ； [(2+i^-fei)(2+i^-*r i -* 

k 

^ 5 ][(l-Ha + /l)(l + |a + ^I)]- 1 -«<C (14 |a|)- l - e ,* 


(9.1.14) < C f ； 少 fl + 分 ^1) 

< C ^ 2^'^ (l + 2^i 少 +i ) 1 〜 


(bocMm |^-^< 2 ^° +1 ) 
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< C 2 ~ 3t> 52 2 j ’(1 + 2 j ’)+* 

y=i 

< a 2~ J0 <2& \x- yl' 1 . 

It thejefore follows that (iC(x,y)| < C\x — yf' 1 . 

4, For the 搜 timat 槐 on d x K, d v K 、we write 

\d x K(x t y)\ < ^2 2- J |^(2- J x~Jfc)| |^(2^x-Jb)| 

J，* 

< C ^2 2 ^ [( 1 + \ 2 ^ x ~ 利 )(1 + | 2 ^-fc|)] 

， 3,k 

and we follow the same technique; we obtain without difficulty 
t |a i /C(:c ， y)| ， \d y K{x % y)\<C\x~y\" 2 . m 


Prom the discussion preceding the lemma it therefore follows that we have 
proved the following theorem 

Theorem 9 1.6. IJi> is C 1 and | 於 ’( 怎 )| < C(1 +• Jx|) _l_e , and tf the. 

= 2— j/2 jp{2~ J x - k) consfitide an orthonormal basis for L 2 (R), then 
the J,k eZ} also constttuie aA unamditionai basis for cUi tiie U*-spaces, 

\ <p <oo. 

9.2. Characterization of function spac 朗 by means of wavelets. 

Since the constitute an unconditional basts for /^(R), there exists a charac¬ 
terization for functions / G ^(R) using only the absolute values of the wavelet 
coefficients of /- In other words, giwn /, then we can decide whether / € L 1 * by 
looking only at the |{/, lie explicit criterion is, again for 1 < p < cx>, 


/€i ， p (R) 


E exP ( R ) 


Fora proof that these are indeed equivalent characterizations of y(R), see Meyer 
(1990). 

Similarly, wavelets provide unconditional bases and characterizations for 
many other fimctional spaces. We list a few here, without proofe. 


The Sobplev spaces W*(R). The Sobolev spaces are defined by 

- 1 /； i/K)i 3 <«} • 
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Their characterization by means of wavelet coeSIdeots is 

/€ iy-(R)^53 K/ t ^ t fc>| 3 (1 + 2- 2 n < 00 . 

、 M 

The Holder spaces C J (R). For 0 < « < 1, we define 

^(R) = w 你 + 岛二 ’㈣ <oo}. 

For s = n + s’，0 < s' < 1， we d^ne 

C^m) = <[/€i°°Wnc^R) ; £ ； fec*^ . 

For integer values of a, the i^>propriate spaces m this ladder are not the tra¬ 
ditional C^-spaces (consisting of the functions that are n times continuously 
<tifferenti&ble) T nor even the Lipschit^-spaces, but slightly larger spaces defined 
¥ 


‘* Zygmund clasB” ， 

{/€ K(R );， 2 ㈣ < 


00 


which takes the place of C l (R) t and 

A ： = lfeL°°(R)nc n - l (R )； 


d"- 1 , A 

^ /eA -J 


For this ladder of Holder spaces one has the following 

» noninteger) o 


A locally inferable /isin^(R) (i 
if and only if there exists C < oo so that. 


) or A" (s * n integer) 


*!(/, M\ < C for aU € Z , 

■ |</，^,*>1 < C 2- 办 +1 / 2 ) for all j > 0, keZ. 


(9.2.1) 


We have inq^tieitly assumed here that ^ e C r i with r > «. 

For proofis and more examples, see Meyer (1990). Of the examples given 
here, the only spaces that can be completely characterized (with **if and only iP 
conditions) by Fourier transforms aie the Sobolev spaces. 

The conditions (9.2.1) characterize gbbol regularit 
also be studied by means of coefficients with respect to 
basis. The most general theorem is the following, due 
simplicity, we assume that 
the theorem is slightly diSereot for 


heorem is tne toiiowing, due to Jattarc 
♦ has compact support andiaC 1 (the 
iereot for more g^n^al 矽 ). 


aces. 

rity. Local regularity can 
to an orthoBCHiDal wavelet 
«e to Ja&rd (1989b). For 
diaC 1 (the fonnulation of 
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Theorem 9.2.1. If f is Holder contimutus with exponent a, 0 < a < l, at 
xq, n, 

\f{x)-nx 0 )\<C\x-~x 0 \ a , (9.2.2) 

then 

maxlK/^-j,*)! dist (i 0 , support ( 分 _),*))，= O (2 _( 卜 oW ) (9.2.3) 

for j—oo. Conversely, */(9.2,3) holds and if f is known to beC* for some e > 0, 
then 

l/(x) - /(x 0 )|<C|x-x 0 r log (9-2.4) 

We do not have exact equivalence between (9.2.3) and (9.2.2) here. The estimate 
(9.2.4) is in fact optimal, as is the condition / € C*: if /is merely continuous, or 
if the logarithm in (9.2.4) is omitted, then counterexamples can be found (Jaffard 
(1989b)). Non-equivalence of (9.2.2) and (9.2.3) can be caused 如 the existence 

of less regular points near io, or by wild osciUations of f(x) near xq (see, e.g., 

Mallat and Hwang (1992)). If we modify condition (9.2.3) then these 

problems are circumvented. M<»re precisely (again with ccmipactly supported 
tp 6 C l ), we have the following. 

Theorem 9.2.2. Define, /or c > 0, 

5(x 0 , 7 ； €) = {kez ； support ( 外 ,*)n 】 3! 0 - ^Co + <[# W* 

If r for some c > 0, and some «r, 0 < a < 1, 

max |{/, ^,*)1 = O (2 - 义叫 ， （ 9.2.5) 

fc€5(x 0 j;«) V , 

then f is Holder continuous wWi expoxunt a in xq. 

Proof. 

1. Choose any x in \xq - e, xq + c[. Since either # 0 or 〆 0 

implies k G 5(a ： o,.；；€), we have 

/(a：) - /(x 0 ) - 5^ (/i 1^**(®) - 

= 5^ Yh 私 .*> 1^3,k( x ) ^ V*i,fc(«o)] - 

i kes{xojit) 

it follows that 

i/ ㈤- fM\ <x；^ ^ +a) E 吣，办 )- 也 〆 抑)卜 

) fc€S{*0J；«) 
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2. Since 0 has compact support, the number of k for which ^ 0 or 

^ 0 is bounded, imiformly in j, by 2 |support(^)j. Consequently, 

fcPS{x 0 ,j;«) 

<Ci max |^k(z) - ^ t ft(xo)| 

< C 2 2 一 taax \if(2^x -k)~ ^( 2 ^X 0 ~ ^)1 • 

Since tff is bounded and C l % 

(V>(2 _i x -k)~ V>(2 - ^aco - ^)1 < Cs min (1 ， 2~ j \x - xo|). 

3. Now choose jo so that 2 J0 < ja: - xq\ < 2 知 +1 _ Then 


t/(x)-/(zo)| < C X C 2 C^ 


Jo 


E ^ + E 


产 Jo+l 


Remarks. 

1. Similar theorems 


< CU [2 °加 + <C 5 |a;-xo| Q . 


1 , of cout 给 ， be prtuved for <7°-space8 with q > X. 


2. If a = 1 (or more generally, a € N), then the very last step of the proof 
does not work any more，because the second series will not converge. That 
is why one has to be more circumspect for integer a, and why the Zygmund 
class enters. 

3. Theomns 9.2.1 and 9.2.2 are also true if 妒 infinite support, and ip and 
畛 ’ have gtKKl decay at 00 (see Jaffard (ldwb)). Compact support for iff 
makes t&e estimates easier, o 


Local regularity can therefore be stucfied % means of wavelet coefficients. 
For practical purposes, one should beware, ^oirever: it may be that very large 
values of i are needed to determine a in {9,2.5) rdiably. This is illustrated by 
the following example. Take 、 

f(x - a) = 2 €-1*-°' * if x<a-l, 

. if a-l<x<a + l , 

+ l| if x>a + l ; 

边 li foncfeion Is graphed in Figure 9.1 (with a = 0). This function has Holder 
0 t 1, 2 at ® ~ a - 1, a, a 4 * 1, req>ectively, and is C°° elsewhere. 
C^ie bto for each of the three points * 0 =： o - 1, a, or o + 1, compute 
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/" are dUconti^ .touM. 


Aj = max {({/» %*)(; xo ^ support {分从)}， and plot log log 2. If a « 0, 
then these pfcis line up on straight lines, with slope 1/2, 3/2 and 5/2, wkh pretty 
good accuracy, leading to good estimates for a. A decomposition in (^thonormal 
wavelets is not translation invariant, however, and dyadic rationals, particularly 
0， play & very special role with respect to the dyadic grid {2~^k\ j,k € Z} 
of localization centers for our wavelet basis. Choosing different values for a 
.illustrates this: for a - 1/128, we have very different (/, ^,*)» ^ still a 
reasonable line-up in the plots of logi4^/lo^2» with good estimates for a; for 
irrational a, the line-up is much less impressive, and determining a becomes 
correspondingly less precise. All this is illustrated in Figure 9.2, showing the 
plots of log Aj(\og2 as & function of j, for xo = o - 1, o, o +1 and for the three 
choices a ~ 0 f 1/128 and %/2 - 11/8 (we subtract 11/8 to obtain a close to zero, 
for programming convenience), lb make the figure, |〈/， 矽-么 was computed 
for the relevant values of k and for j ranging from 3 to 10. (Note that this 
means that / itself had to be alunpled with & resolution 2 -17 , in ordo* to have 
a reasonable acciiracy for the j — 10 integrals.) For a = 0, the eight points line 
up beautifully and the estimate for a + 圣 is accurate to less than 1 •撕 at al] 
tiffee locations. For a = 1/128, the points at the coarser resolution scales dojiot 
align as well, but if cr + 奏 is estimated from only the finest four resolution points, 
then the estimates are still within 2%. For the irrational choice 0 = ^/ 2 - 11/8 
no alignment can be seen at the discontinuity at a -1 (one probably needs even 
smaller scales), and the estimate for a -f | at a, 育 here / is Lipsdiitz，is offby 
about 13% (interestii^ly enough, the estimate wwald be much better if the scale- 
10 point were deleted); at a + 1， where f 1 is Lipsdutz, the estimate is within 
2.5%. This illustrates thftt to determine the local regularity of a function, it 
is fnore useftil to use very redundant wavelet fomilies, where this translational 
non-invariance is much less pronounced (discrete case) or absent (continuous 
case). (See Holsdineider and Tchamitduan (1990), Mallat and Hwoog (ld92).) 
Another reason for using very redundant wavdet families for the characterization 
of local regularity is that then only the numb^of vanishing moments of ip limits 
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the maximum regularity that can be characterized; the regularity of iff plays do 
role (see §2.9). If orthonormal bases are used, then we ate necessarily limited by 
the regularity ci V* itself, as is illustrated by choosing / = For this choice we 
have indeed = 0 for all j > 0, all k; it follows that with orthonormal 

wavelets we can hope to characterize only regularity up to if iff € CT. 

9.3. Wavelets for 

Since L 1 -spaces do not have unconditional bases, wavelets cannot provide one. 
Nevertheless, tl^y still outperform Fourier analysis in some 岛概 ise. We will il¬ 
lustrate this by & comparison of expansions in w&velets versus Fourier series of 
£*([0, l])-functions. But first we must introduce “periodized wavelets.” 

Given a nmltiresolution analysis with scaling function <j> and wavelet both 
with reasonable decay (say, |0(ir)J, |^(ar)| < C(1 -t- Jil) -1- *), we define 

~ 5Z 炎 ，■,*(* + ’)》 ^jje ~ X-I + ； 

i . 

.and 


Vf^ = Spah {^I r ; k€Z} ( Wf* r - Span {^; k € 2 }. 

Since + f)- — 1 ,* we have, for j > 0, = 2~^ 7 

53^(2-^ - + 2_") = 2 "夂 so that the V/* r , for j > Q, are ail identi¬ 

cal one-dimensional spaces’ containing only the constant functions. Similaxly, 
because Yle ^( x + 名 /2) = 0, 7 — {0} for j > 1. We therefore restrict 

our attention to the Wf n with j < 0. Obviously Vj^ ， Wj^ C 
a property inherited from the non-periodized spaces. Moreover, Wj^ x is still 
orthogonal to because 

/⑻ 

Jo 

_ * _ 

=V 2~M dx + 2~U~k) 0(2 勹 a? + 2-^- ^) 

tjiz Jo 

f9f +1 

Y\ 2 WI / dy ^(2 wl y + 2 叫 ~ t) ~ k) 0(21%-V) 
tjU h， 

(bc^cause j < 0) 

= 批，*+3… r ，* 0 . 

t€Z ^ * 

It foikvws that, as in the non-periodized case, Vj^\^ = Vf* 1 Hie spaces 

Vj^ r Wf 91 are al| fiflite-dimensional: since — ^j t k for m € Z，and the 

same is true for 0, both and Wf 01 axe spanned by the 2 ⑷ functions obtained 
from k — 0,1,**-,2^1 — 1. These 2^1 functions are moreover orthonormal; in 
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e.g” we have, for 0 < k t k f < 2^ - X, 

、 reZ 

We have therefore a ladder of multiresolution spaces, 

vrcv^rcv^c - , 

with successive orthogonal complements (of in V^J r ), W^, .、. ， and 

orthonormal bases {<t> 3i k\ k = 0, * • * 2^ - 1} in {^j.fc ； k = 0, * * •, 2^ - 

1} in W^ T . Since U j6 _nV^ I>er — L 2 ((0,1]) (this follows again from 

the corresponding non-periodized veraon), the functicms in U 

—j € N, A: = 0, • * ■ ,2 tjl - 1} constitute an orthonormal ba»s in L a ([0,1)). 
We will relabel this basis as follows: 


如 (:） 

=1 ~ ^0^)( x ) 


A(:) 

~ ^0,^ ( x ) 


32(:) 



<?3(x) 

== ^^ 0 (® ~ 5 ) = 

9i(x - 

P4(:) 

= 〈0⑷ 


92>{x) 



如 .“ 1 ) 

= 必 O ) = 92i(x-k2^ 3 ) 

for 0 < fc<^ 


Then this basis has the following remarkable property. 

Theorem 9.3.1. If f is a continuous periodic function wiUt period l f then 
there exist a n e C so that 

N 

f - ^ On g n 一 »0 aa N—oo. 

n=0 i 一 

Proof. 

1. Since the g n are orthonormal, we oeceBsarily have o„ = {/, gn). Define 

Sn by 

N 

^/ = </ ，加》 知. 

n=0 
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In a first step we prove that th« Sn are tulifofmly bounded, i.e M 

II^/tlL- < C ll/ll 卜， （ 9.3.2) 

with C inde|>et)dent of / or N. 

2. If AT — 2^, then — Projy^; hence 

2 H 1 -1 

{Svf){x) = Y, </，❿ = / dy K } {^y) f{y ), 

*5=0 J0 


with 


2 ^ 1 -] 


*=0 


K 3 (x t y) - Y1 

Consequently, 

ll^/IU«* < 


sup / dy \Kj{x y y)\ 
*e(o,il ^0 


ll/lk- • 


Now 


sup / dy \K 3 {x,y)\ 

*e|o,if Jo 

,1 屮 1-1 * 

< sup / dy 53 E 10 -^+ 01 l^,k(y + OI 
*€lo t iI h fc ^o i t e^z 

广 00 2 … -1 

<sup / dy Yi 23 \^{ 23 { x + 0 - *)1 M(2 J y ■- *)| 

* t£Z 

3'^-J 

<csu P 52 mx f +ve-k)\ 

\ xf k^o zeZ 

< C sup V |^(ar , + m)| , 

*’ m€Z 

and this is uniformly bounded if |0(x)| < C(1 4 - jxl) -1 -*. This establishes 
(9.3.2) for N=^P. 

3* JfiV = 2J +m,0<m<2J-l, then 


(Sn/)(x) = (S v f)(x) + {/, ^ k ) O). 

fc=0 

f 

BSstinuites exactly similar to those in point 2 show that the L°°-iiorm of 
the second sum te Also bounded by C ||/||^« , uniformly in j, which proves 
(9.3.2) far all iV. 
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CHAPTER 9 


1. Suppose, for simplicity, that 妒 is compactly supported, with suf^jort 

寸 C [-L,2/], For sufficiently large j, this means that = if- 3l k(x) 

if \2~ 3 k — a ； o| <> (Again, this is not crucial. For non-compactly sup* 
ported 也 one only has to be a little more careful in the estimates below. 8 ) 

2. For m ― 2 3 + A:, a m — fdx f(x) i/> 一 j, k (x). Here - 

support ip. Jtk C \2^{k-L), 2^{k + L)) 

C [2-J(xo-L-l), 2~ J (x 0 + i + 1)1 

(because x 0 l < T j ); 

hence 

f {x) 矽 *(ac> 

|a-* 0 |<2-Mi+l) , € 

- fdx lf(x) - /(x 0 ) -(x- x 0 )r(x Q )} ^V(^x-fc) 

卜 :r 0 |S2 - V+l) * 

= o(2 j/2 2 _2j ) ， 

(use /(x) - f(x Q ) -{x- i 0 )/’(x 。） ' o(x - 叫 
and dbange variables: y — 2 J (x - x 。)） * 

二 o( 2~ 3j/2 ) = o{m~ 9/2 ) 

(becMise 2^ <m< 2 J " fcl ) . ■ 


This has the following cc»*o)I«ury. 

Corollary 9*4.2. If t jar all m } C\ m~ 3/2 < (a m | < C 2 m _ 气 with 
Ci > 0 t C 2 < 00, then 2 m=o a m 9 fA is in C a for all ol < 1, bvi is nowhere 
differentiable. , 4 

Proof. Immediate from Theorem 9.2.2 and Lemma 9.4.1* ■ 


L^; us now coi^truct a very particular function. De^ce Om = a v +k = Pjt 
independently of k. Then 


53 Otm 5m = ^ 51 92i+k 

m =0 i =0 fc =0 s 

t - f ； ft E E 少〜的 w - 
1 j=o k=o tez 

- E 2" 3 ft J>(2 心 -no = f ； 2 ^ ftF(2^x), 

j=0 m j=0 
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where F(x) = Yl m ^( x 一爪 ) is a periodic function. We have 
F(x) = [ 

n 

with ^ 

F n = i- jT 4a: F(x) e 2 ™ 1 * = y/2^ ^{2im). 

In the special case where ^ = ^M«y«r (see Chapters 4 and 5)，support tjf * 
K; ^ < |C| < 80 fc hat ^(2im) / 0 only if n = ±1. Moreover, ^(-2?r)= 

^(27r). Consequently, F(x) = A cos{2irx), and 

oo oo 

5 ^ am 9m(3：) = 0J 2 }f7 cos(2 J 2?rx). 

m=0 0 

The “ftill” wavelet series of the left-hand side has a lacunary Fourier expansion! 
If now the 0 3 axe chosen so that C\2^ 3 < 2 J ^ 2 < C 2 2~ J , then we can apply 

Corollary 9.4.2,® and conclude that the function is nowhere differentiable. For 
this special case, this is in fact a well-known result about lacunary Fourier series: 
YI^Lq 7j cos(Ajx), with 卜 ，| < 00 but /+ 0, defines a continuous, 

nowhere differentiable function. 

On the other hand, if we take a ^mction with a localized singularity, but 
which is C°° elsewhere, such as, e.g., f(x) = }sin irx| _a T with 0 < ot < 1， then 
its wavelet expansion will be more or le^ lacunary (all the coe 历 cients decay 
very fast as —j—*oo, except the few for which 2~^k is close to the singularity), 
while the Fourier series is “full ”： / n = 7 Q n~ 1+ * +0{n~ 3+Q ) } with j a / 0; the 
effects of the singularity are felt in all the Fourier coefficients. 

Notes. 

1. Tbere exist many different definitions of Calderdn-Zygmund operators. A 
discussion of these different definitums and their evoluticm is ^ven at the 
start of Meyer (1990, vol. 2). Note that the bounds are infinite on the diag¬ 
onal x — y; in general K will be singalaroci the diagonal. Strictly speaking, 
we should be more careful about what happens on the diagonal. One way 
to make sure everything is well defined is to require that T is bounded from 
Vtoiy (P is the set of all compactly supported C°° functions, its dual, 
the space of (non-tempered) distributioas), and that if x ^ support (/), 
then (Tf)(x) = f dy K(x i y)f(y). It then follows that K does not com¬ 
pletely determine r: the operator (T\f)(x) — (Tf)(x)-\-m(x)f(x) t with 
m G L°°(R), has the same integral kerx^l. See Meyer (1990, vol. 2) for a 
clear and extensive discussion. 

2. Note that If • ||x,i constitutes a (very convenient) abuse of notation. As 

for example, by || |x - X| _l + |* + 1| _1 ||^ > ||(ar- + 
轉 JiHt 1 » the triangle inequality is not satisfied, so that ||.||i» is 
not & Hrue" ncSm. **** 
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3. If the W weak n is dropped, then the theorem is known as the Riess-Thorin 
this case K - 


not 


>rem; in 
necessary. 


and the restriction < Pi, ^ < P 2 is 


4. 


(1 + |a - tj)" 1 -* (1 + |6 — fcj)" 1 - 8 <X；(l + |a-A：!)- 1 - 

k * oo 

< 0 sup j ^(1 + k- kiy 1 ^ < 25^(1 + 0 _1 ' e < oo . 

5. We can suppose without loss of generality that a > 0. Find k so that 
A: < o < fc + 1, Then 

+ (1 + la + ^ir 1 - 

t 

< E [(l + {k + m (l + ^l-Ar-l))]- 1 -* 

l=-oo 

* 

+ [ 1(1+(*;-€)) (l +(fc+ f )) 广 h 

t^~k * 

+ f ; [(1+0-* _ i »( l +(“*)) 广 1 - e 

t^k+1 

k * 

<2^]n-(Jb- e)]~ 1 -* (1 + 2ky l ~ e 


t=0 


+2 乞 [I + (/ - Jb - l)]~ l - e (1 + 2Jfc)- l ~ e < C(1 + H)- 1 -*. 


t=k+l 

6. In Note 9 o£ C 


In Note 9 o£ Chapter 5 we saw that tj>{x -I- £) : 
f^dx ^(ar) ― 1, this consfcai^ Is necessarily equal to 


constaot. Since 


^2 rp{x + £/2) = ( -1 ) n *-n+i 4>{2x + e-n) 

t t « 

-[(-1 广 +1 ^0(2: + *) 

Jk，m 

(k^t-n t m = -n + 1) 

= 0 (because '£,h 2m == I> 2 m+i). 

8. By now, the reader has seen so many instances of this type of estimate 
that I leave the proof of Lemma 9.4.1 for non-compactly supported but 
well>decaying ^ as an exercise. 
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9. Yes, Meyer’8 wavelet does not have compact support, and the proof of 
Lemma 9.4.1 uses that tp is compactly supported. See, however, Note 8 
above. r K 



CHAPTER 10_ 

Generalizations and Tricks for 
Orthonormal Wavelet Bases 


This diapter consists of several generalizations and extensiotuB of earlier amstruc- 
Uobs. These are not treated with the same detail as in the previous dusters. 
Some of the topics are still developing, and I expect that any write-up on them 
would look very different even two years from now. The sections cover multi¬ 
dimensional wavelets with dilation factor 2, via tensor product multiresolution 
analysis, or via nonseparable schemes; ortfacmormat wavelet bases with xlilation 
factor different from 2, integer or non-integer; the “splitting trick” for better 
frequency resolution (in fact, merely a specie^ case of the *Siavelet padrets” of 
Coiftnan and Meyer); wavelet bases on an interval. 

10.1. Multidimensional wallet bases with dilation factor 2. 

For simplicity, we will consider only the twcwiiixieiisioii^ case; higher dimensions 
are analogous. One trivial way of constructing &n orthonormal basis for L 2 (R 2 ), 
starting from an orthonormal wavelet basis = 2~ 3 ^ 2 r^(2~ 3 x — k) for 

L 2 (R), is ^mply to take the tensor product'functions generated by two one- 
dimeosioaal bases: 

* = ^Ja.*a( x 2) - 

The resulting functions are indeed wavelets, and {屯力 ，幻； 办， jb 3 ; € Z} 

is an orthonormal basis for L 2 (R 2 ). In this basis the two variables x\ azid x% are 
dilated s^arately. 

There exists another construction, more interesting for many applications, 
in which the dilations of the resulting orthonormal wavelet haa& control both 
variables simultaneously. In this construction，one consideiB the tensor product 
of two one-dimensionai multiresfdiitioii analyses rather than of Uie corrospcaiding 
«»velet bases. More precisely, define spaces V Jt j G Z, by 

V 0 - V 0 ®Vo = Span{F(a?,y) * f(x)g(y)\f t g € , 

F€V 3 ^F(^^)€V 0 . 

Then il» form & multiresolution latkto in i a {R 3 ) 

..••V 2 C Vi C V。 C V — 夏 C V - 2 …， 
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10.1. Multidimensional wavelet bases with dilation factor 2. 

For simplicity, we will consider only the twcMiinienaaonai case; higher dimensions 
are analogous. One trivial way of constructing an orthonormal basis for L 2 (R 2 ), 
starting from an orthonormai wavelet basis = 2~ J f 2 ^(2~ 3 x - k) for 

L 2 (R), is simply to take the tensor product' functions generated by two one- 
dimenwooal bases ： 

• ^ia.*a( x 2) - 

The resulting functions are indeed wavelets, and € Z} 

is an orthonormai basis for L 2 (R 2 ). In this basis the two variables xi and x% are 
dilated s^>arately. 

There exists another construction, more interesting for many 
in which the dilations of the resulting orthonormai wavelet bagd& 
variables simultaneously. In this construction, one consideis the 
of two one-dimensionai multiresdutlon analyses rather thanoftiie 
b. More precisely, define 印 aces V Jt j 6 Z, by 



… V 0 « Vq®V 0 = Span{F{a?,y) ® /( 咖 (tf);/,p € 托 } ， 
* F€V 3 ^F(^^)£V Q . 

Then tte Vj formamultiresolutiozk laddet in L a {R 3 ) satlsfysxig 


- * *A^2 C Vi C Vo C V—i C V_2 …， 
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H V i * W- U V > = - ! 

i€Z >eZ ' I 

Sinci the - — n), n € Z, constitute an orthonormal basis for Vq, the product 
functions | 

• ^o ； n,,n,(x,y) = - ni) <f>{x - n 2 ) , ni,n 2 e Z , 


constitute an orthonormal basis for V 0 , generated by the Z 3 -translatioiis of & 
single function Similarly, the 

^ini,na(*»y) = ^j,n a (y) 

= 2~^(2~^ ~m f 2~ j y ~n 2 ) „ ni,n a € Z , 


constitute an orthonormal basis for V^. Aa in the one-dimensional case, we de¬ 
fine, for each j € Z, the complement space Wy to be the orthc^onal complement 
ia Vj] of、. Wehave 

Vj-i = Vj. r ® Vj- X = (Vj © W,*) ® © M^) - 

= Vj^VjeKw^v^eiVj^w^miw^Wj)) 

= Vj-®W[ 

It follows that Wj» consists three pieces, with orthonormal bases given 
by the ^j, ni (x) 0>,« a (v) (for ® Vj), ^j,n a (y) (for Vj ® Wj), and 

(ac) ^i.na (y) (for Wj ® H^). This leads us to define three wavelets, 

9 h (x t p) = 4>(x) Hy) 

9 v (x t p) - <f>{y) 

^ d {x y y) = i/f(x) tj){y) 


(h, v, d stand for horizontal, w ^vertical,” “diagonal,” respectively; see below). 
Then 

«i.»a e Z, A = V or d} 
is an orthonorpial basis for W^ f and 

{^> ； n ； 3 € Z, n € Z a , A - /», t> or d} 

fsanorthoiiornttlbasisfor ㊉ = t 2 (U 3 ). 

jeZ 

!f ， in this construction, the original one-dimeiiBioiial ^ and iff have compact 
support, then obviously so have $ and the % x . M^eover，the interpretation 
in terms of subband fflteriiig of a decomposition with respect to such 叫 or- 
thonormal basis of compactly supported wavelets’ as explained in §5.6, carries 
rhe filtmng can be done cm ** 10 ^ 8 ” and u colun 
f t corresponding to horizontal 


as 

to two dimensions. The filtering can be done cm M rows” and “columns” m 
他 e two-dimeD«ionaI array, oorresponding to horizontal and vertical 
in images, for example/ Figure 5.7 becomes，in two dim^isioiis, the schematic 
representation in Figure 10.1. 



Fig, 10, U Sekentat%e rvpmentation oflftpeated low- and high-pan filtering, on rottm and 
oolumru, for a iw^dimensumal wav^et dacompoMition, 

The d 1,A correspond exactly to the wavelet coefficients (F,^ n ), with F = 
In an image, horizontal edges will show up in d 1,h , vertical edges 
in d l * v t diagonal edges in d lid , as illustrated in the image example below. (This 
justifies the h t v f d superscripts.) Note that if the original image (c°) consists of 
an. N x N array, then (apart from border effects; see also §10.6) r every array 
d 1,A consists of y x y elements, and can therefore be represented by an image 
(magnitudes of the c<Jefl5cients corresponding to grey levels) of one quarter the 
size of the origui&l. The whole scheme can therefore be represented as in Fig¬ 
ure 10.2. Of course, one can decompose c 2 even further if more multiresolution 
layers are wanted. Figure 10.3 shows this decomposition scheme on a real image, 
with three multiresolution layers. 



original dccompoutioD into two layers 
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eralizations of (5.1.1)-(5.1.6)) in which V 。 is not a tensor product of two one- 
dimensional Vo-spaces. 1 Some (but not aUl) of the constructions done in one 
dimension can be repeated for this case. More precisely^ the multiresoluticm 
structure of the Vj implies that the correspondix^ scaling function $ satisfies 

h nun2 ^(2x~n u 2y-n 2 ) (10.1.1) 

ni t n3 

for some sequence (hn)n€Z 3 . Ortbononxiatity of the forces the trigcmomet- 
ric polynomial 

to satisfy 

1 狗 (€ ， 0 卩 + l»no(C + ^C)| 2 + jmo(C，< + w ) 卩 + |w»o(4+^,C + tt)| 2 =： 1. (10.1.3) 


To construct an orthonormal basis of wavelets corresponding to this multireso- 
lution analysis, one has to find three wavelets 伞 \ 中 2 , 少 3 in V_i, orthogonal to 
Vo and such that the three spaces spanned .by their respective integer translates 
are orthogonal; m^eover the ^ A (--n) should also be orthonormal hr each fixed 
A. T^is implies that 


抑， c 卜 “)， 

where the mi,m 3) m 3 are such that the matrix 


f mo«，0 

爪 0 < 《 + 开 ，0 

呵 (« + 霣 ) 


mi(C + 7r ， C) 


， 2(《，0 

m 2 K ， <+ir) 


饥 3 (< ， C) 
m 3 (€+7T ， C) 
m 3 (《，C + 霣 ) 


\ f7ioK + ir,C + ir) mi(^ + 7T,C + ?r) ma(4 + 霄， C + w ) m 3(C + 冗，（ + 兀 ) / 

(10.1.4) 


is anitury. The analysis leading to tbia ccmdition is entirely similar to the one- 
dimeittBOii|i| analysis in §5.1; see, e.g” Meyer (1990, §III.4). 2 

Not^^at the number of wavelets to be constructed can be determined by 
an easy tt^ok, In two dimensions, for example, V 0 is generated by the translates 
of one function ^ over Z 2 ; the space V_i is generated by the translates 
; of ^(2x t 2y) over ^Z? t or equivalently, by the Z 2 -traos1iites of the four functions 
^ ^(2ic, 2y) % i(2x — 1, 2y) t ^(2ac, 2y — 1), ^(2x - l,2y- 1). V_i is therefore ^our 

< tim 明 as big** as Vo. On the other hAiid, each of the Wo-spaces is generated 
I by the Z 3 -traaslates of a sii^ie funcdon ^(x t y) t and is therefore M of the same 
r, size” as V 0 . It follows that one nec^te three {— four minus one) spaces Wj 
: (hence three wavelets 炉 > to make 知 ' _TiDoiiijilement of V 0 in V-j. This ride 
may aound tike “hand-waving,” but wecaxi'dlad t^hrase (and prove) it in more 
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* mathematical terms ： the number of wavelets is equal to the number of different 
coeets (different from 7? itself) of the subgroup Z 2 in the group 5 Z 2 . 

In' the general n-dimensionai case, the same rule shows that there are 2 n — 1 
different functions rrij to jdetermine; they have to be such that the 2 n x 2 n - 
dimensional matrix 

- 讯 r-i(Cl + + a nTT) (10.1.5) 

is unitaiy, with r = 1 ， … , 2 n , and s - (a 1} - ■■,«„)€ { 0 , l } n . 3 

In fact the unitarity requirement of (10.1.4) or (10.1.5) c»Us for a tricky bal- 
smce: mj,m 2 ,m 3 have to be found so that the first,row of (10-1.4) has unit 
norm，whidj seems harmless enough, but 辦 also ^moltaxieoilfily need orthogo- 
ludity with and among the other rows, which are all shifted versions (in ^ or C) 
of the first row. These correlations between the rows may be hard to juggle in 
practice. It is useful to untangle them first, which can be done via the so-called 
polyphase decomposition. We write, e.g” 

2mo(^C) = mo,o(2e,2C) + e^mo^ %) + 2<) 

+ e-'< €+ <>mo, 3 (2^,2C )； 

mtj, j : 0 , … ， 3, are defined similarly from m/, , = 1 〆 * • ， 3. One easily chedts 
that (10.1.3) is equivalent to 

|mo,o(2 《， 2C)| 2 + Imo〆 ％， 2<)| 2 + |m©,2(2C ， 2<)] 2 + }mo,3(2^, 2<) 卩 =1 . 


Similarly, aU the other conditions ensuring unitarity of (10.1.4) can be recast in 
terms of the mej', one finds that (10.1.4) is unitary if and only if the polyphase 
matrix 


( T^O.ot^C) 

饥 0,1(C ， C) 

m 0 ,2(C,C) 

^ ^0,3(^, 0 


«» i ， o ( C ， C ) m 2, oOS ， C ) 饥 3, o ( C ， C ) 、 
叫 ，1(《， C ) 饥 2，1(《， C ) 爪 3,1(1，0 

• 饥 2,2(《，0 m 3,2($，0 

饥 ^ 2 , 3 (^, C ) m 3,3{^0 > 


is unitary. 

In n dimensions, one similarly defines 


( 10 . 1 . 6 ) 


..，《《)=[ c " i( * ，Cl+ " + ， ； €n) 叫 ,sd … , 瓜 ) ， ， 

*€{ 0 ,l} n 


and the unitarity of » equivalent to the unitarity of the polyphase matrix V 
de&ied by 

、 ****$»)= • * * »^n) • 、 (10.1.7) 

The construction therefore boils down to the following question: given mo 
(from ( 10 . 1 . 1 ), ( 10 . 1 . 2 )), can mi, … ， ma«_i be found such that ( 10 . 1 . 6 ) is uni¬ 
tary? In the two-dimensional case, and if mo(^,C) happens to be a real trigono¬ 
metric polynomial, then one can even dispense with the polyphase matrix: it is 
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easy-to check that the choice mi(^,C) = + fl", C)> m 2 (^,C) = e_*( €+ 0 

mo (《乂 + 7T), 爪 3 («) = c~^mo(4 + tt,C + tr) makes (10.1.4) unitary. If mo is 
not real, then things are more complicated. At first sight one might even think 
the task is impossible in general in the n-dimensional situation, where (10.1.7) 
is a 2 n x 2 n -matrix: after all，we need to find unit vectors, depending continu¬ 
ously on the (namely the second to last columns of (10.1.7)), orthogonal to a 
unit vector (the first column of (10.1.7)), i.e.，tangent to the unit sphere. But 
it is well known that w it is impossible to ^omb a sphere, M i.e., there exist no 
nowhem-vanisbing continuous vector felds tangent to the unit sphere, except in 
real dimtmsians 2, 4, or 8. The first column in (10.1.7) does not describe the ^ill 
sphere, however; in fact, because it is a continuous function of n vuriabies (the 
^it • • * *^«) *** a 2 n >dimensional space« and 2 n > n, it only describes a compact 
set of measure zero. Thia fact saves the day and makes it possible to construct 
mi,*--as shown by Grochenlg (1987); see also pU.6 in M^er (1990). 
Grdchenig’s proof is not ccmstructive; a different, constructive proof is 真 iven in 
Vial (1992). Unfortunately, these constructions can not force compact support 
for the even if mo is a trigonometric pdynomial (only finitely many hn ^ 0) t 
the m ) 紙 not necessarily. 

10.2. One-dimexis!oiial orthonormal wavelet bases with Integer* 
cUIation factor larger than 2. 

For illustration purposes, let us choose dilatHm &ctor 3, A multiresolution anal¬ 
ysis for dilatkHi 3 is defined in exactly the same mty as for dilation 2, i.e., by 
except that (5.1.4) is replaced 

We can use the same trick again as above: is g^ner^ted by the integer 

translates of one function, i.e., by the ^>(x - n), VLi is generated by the 
<l>(3x - n), or, equivalently, by the integer traodti^eS of three functions, ^(3x) t 
0(3ac - I), and ^(3x - 2). V-\ is “three tkoes as big** as Vo, and two spaces of 
the “same as Vo are needed to compkmeiit Vq and constitute V_i ： we will 
need two spaces Wj, Wj, or two wavelet^, ^ and iji 2 . 

We can again introduce mo, mi,ma by 

mo_ km 、 卜 2 • 

Orthononnaliiy of the whole family { 如 , € Z}，where ^, n is now 
defined by 

^j,n(x) = 3_" 2 - n) 

n are defined analogously), again forces several orthononnality conditions on 
the*mi, which can be suminarized by the requirement that the matrix 
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/ ^(4) 叫⑹ m 2 ⑹ \ 



is unitary. Again, one can restate this in terms of » polyphase matrix, removing 
the correlations between the rows. Explicit choices of for which 

(10.2.1) is indeed unitary have been constructed in the ASSP literati^e (see, e.g., 
V&idyanathan (1987)). The question is then again, as in<Chapter whether 
these filters correspond to bona fide L 2 -fuucti^as'^, and 岭 2 , whether the 

k constitute an orthonormal basis, and what the regularity is of all these 
functions. We know, from Chapter 3, that 必 1 and 妒 2 must necessarily have 
integral zero, corresponding to mi(0) = 0 — ⑼. Since the first row of 

(10.2 1) must have norm 1 for 迎 《， it follows that mo(0) = 1 (wlucli k necess^y 
anyway for the convergence of the infinite product fj 二 i 陶 (3 _ ，0 which defines 
4>(0)- The first column of (10.2.1) must also have norm 1 for ail so that 
mo ⑼ =1 implies mo ( 警 ） = 0 — mo(^)» i 吻⑹ is divisible by • 

If, moreover, any smoothness for 欢 、岭 2 is desired, then we need additional 
vanishing moments of 少 1 , 伞 \ which by exactly the 紐 me argument as before, 
lead to divisibility of mo(0 by ((1 +e~ 2,< )/3)^ if € C L ^. One 

is thus led to looking for hi© the type t?»o(0 = ((1 + e 一劣 + 
such that |mo(OI 2 + |mo(《+ ^)P + I«»o(C + 夸 )l 2 二 1 . If 呵 is a trigonometric 
polynomiftl, this means tluit L ~ |jC 卩 is again the solution to a Bezout j^oblem. 
The minimal degree solution lead? to hmctions tf> with arbitrarily high regularity; 
however, the regularity index only grows logarithmically with N (L. Villemoes, 
private communication) Once mo is fixed, mj and m2 have to be determined. 
The design scheme explMned in Vaidyanathan et al. (1989) gives a way to do 
this. In this scheme, the matrix (10.2.1) (or rather, its 2-notation eqmvalent) 
is written as a product of similar matrices the entries of which are much lower 
degree polynomials, with only a few parameters determining each factor matrix. 5 
If one imposes that the first column of a product of such matrices is given by 
the mo we have fixed, then the values of these parameters are fixed likewise, and 
mi, m 2 ca^ be read off from the product matrix. 6 

If t!ie compact support constraint is lifted, thea other constructions are pos¬ 
sible. In Auscher (1989) one can find examples where ^ and^ are C°° functions 
with fast decay (and infinite support). 

One final remark about dilation factor 3. We have seen that mo must neces¬ 
sarily be divisible by (1 + e 一吒 + c~ a< ^)/3. This factor does not vanish for 《 =tt 
( unlike the factor (1 + e~^)/2 for the dilation factor 2 case). However, if we 
want to interpret mo 明 ft low-pass filter, then mo(ir) = 0 would be a good idea, 
lb ensure this, we need C(it) = 0, which means going beyond the lowest degree 
solution to the Bezout equation for |£| 3 . 
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Similar constmctions can be' made for larger iixbeger dilation factors. For 
non-prime dilation factors a, one can generate acceptable mt from constructions 
for the factors of a, although not all possible solutions for dilation a can be 
obtained in this way. For a = 4 f e.g., one cod start Irom & scheme with dilation 
2 and filters mo and mi, and one can define tbe filters mo,»wi,ni 2>^3 (still 
orthonormal ； the * distinguishes them from the dU&tkm factor 2 filters) by 

^(0 = m 0 (O wl oU/2) , mjU) = mi(4)mi(^/2), 

兩 1(0 = w»o(4)mi(4/2) , m 3 tf) = »H(C)wo(C/2). 

(It is kft to the reader as an exercise to prove th&t this leads indeed to an 
orthonormal basis. One easily checks th&t the 4x4 analogue of (10.2.1) is 
unitary.) Note that the fanttloa 4> is the same for tbe factor 4 and the factor 2 
constmctioosl We will come back to tl»s in §10.5. 


10.3. Muttidimenstonal wavelet bases with matrix dilations. 

This is a generalization of both §10.1 and §10.2: the multiresolution spaces are 
subspaces of L 2 (R n ), and the basic dilation is a matrix D with integer entries 
(so that DZ n c Z n ) such that all its eigenvalues have absolute v^Iue strictly 
larger than 1 (so that we are indeed dilating in all directions). The number of 


wavelets is again determined by the number of cosets of DZ n ; one introduces 
again mo’mn • • , and the orthonormality conditions can again be formulated 
as a unitarity requirement for a matrix constructed from the m^, • . The 

analysis for these matrix dilation cases is quHe a lat harder than for the one- 
dimensional case with dilation 2, and, depeoding on the matrix chosen, there are 
a few surprises. One surprise is that gei^-alhdiig tbe Ha&r basis (i.e., choking 
mo so that all its nonvanishiiig coefficients are equal) leads in many cases to 
a function ^ whidi is the indicator function of a ^elfsimilar set with fractal 
boundary, tiling tbe plane. For two dim^sions, with X) = (} ~}), e.g” one 
finds that ^ can be the indicator function of the twin dragon set, as shown in 
Grochenig and Madych (1992) and Lawton and Resnikoff (1991). Note that sudi 
firactai tiles may occur even for D = 2 Id if mo is dhosen ^on-canonically" (e.g M 
^0(^0 = |(1 + + e 一咐 +c) + in two dimensions ― see Grochenig 

and Madych (1992)). For more complicated (not all coefficients are equal), 
the problem to ccmtrol regularity. Zero moments for the ^ do not lead to 
factorization of mg is these muitidimenskmal cases '(because it is not suffident 
to know zeros of a muhi-v^riable polynomial to factorize it), and one has to 
resort to other tricks to control the decay of 

A particularly interesting case is given by tbe “quincunx lattice,” Le.，the 
two-dimensional case where Dt? ^ {(m, n); m + n e 2Z}. In this case there 
is only one other coset, and therefore 01 % pne waVelet to construct, so that the 
choice for is as straightforward as it was for dilation 2 in one 
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conditions m mo, mi reduce to the requirement that the 2x2 matrix 

/ moW.C) m x (^C) \ 

V + mi(C + ?r,C + ^) / 

be unitary. It is convenient to choose 

m 1 ( 《， C)y lf m Q (《 + 7 r ， < ； + 霄 ）. 

Note that any orthcmormal basis for dilation factor 2 in one dimension auto- 
maticaliy gives rise to a pair of candidates for mo, mi for the quincunx scheme: 
it suffices to take mo(C,C) = (4) (wbeFe is the one-dimensional filter). 7 

Different choices for D can be made，however. Two possibilities studied in de¬ 
tail in Cohen and Daubechies (1991) aod KovadeviC and Vetterli (1992) are 
Di = (J ~\) and £> 2 = ({ ). The same cboke for leads to very different 

wavelet bases for these two matrices; in particukirrif one derives, via the mecha¬ 
nism explained above, the filter mo from the “standard” one-dimensional wavelet 
filters ivmo in §6.4, then the are increasixigly regular 铋 is chosen 

(with regularity index proportional to iV), whereas choosing 认 leads to ^ which 
are at most continuous, regardless of iV, Other choices for Z> may I^ad to yet 
otb^r families, with different regidarity properties again. One can of course also 
choose to construct two Inorthogonal bases rather than one orthonormal basis, 
as In §8.3; for the choices Di 、 D% several possibilities are explored in Cohen and 
Daubechles (1991) and Kova^evi^ and Vetterli (1992). lathis biorthogonal case, 
one can again derive fitters &om one^dhatensional constructions. If one starts 
from a symmetric biorth<^oiud filter pair in one (ttmensioi), where ail the filters 
are polynomials in cos《 ? then it suffices to replace cos^ by |(cos^ + cobC) in 
every 也 ter to obtain symmetric btorthogonai filter pairs for the quincunx case. 8 
Because of the symmetry of t&ese examples^ the matrices D\ and D 2 lead to the 
same functions 0,0 in thfe case. One finds again that； symmetric biorthogonal 
bases with arbitrarily high regi^arity are possible (see Cc^ict and Datd>echies 
(1991)). The quincunx case is of interest in image processing because it treats 
the different directions more homogeneously than tlie 8eparable (tensor-product) 
two-dimensional schme: Instead of havipg two favor^e (Erections (horizontals 
and verticsds), the quincunx schemes treat hormmtaIs T verticals’ and diagonals 
on Uie same footing, without introducing redundancy to achieve this. The first 
quincunx subbaiid filtering schemes, with alladng cancellation but without ex¬ 
act reconstruction (whic)i had not been discovered even for one dimension at 
the tune) are given in Vetterli (1984}’. Beauveau <1990) contains orthonormal 
and biorthogonal schemes, and links them to wavelet bases; Vetterli, Kova6evi6, 
and Le Gall (1990) discusses the use of pei^ect reconstruction quincunx filter¬ 
ing schemes for HDTV applications. In Antonini, Barlaud, and Mathieu (1991) 
biorthogonal quincunx decompositions combined with vector quantization giye 
spectacular results for image compaction. 
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with non-integer 


In one diznension, we haw so £ar cafy discussed hxl^er dilation factors > 2. 9 
Non-integer dilatson factors are also pondble ， however. Within the framework of 
a multiresolution analysis, the dilalian bctor must be rational 10 (for a proof, see 
Auscher (1989)). It had already been pointed out by G. David in 1985 that the 
construction of the Meyer wavelet could be generalized to dilation a for 

* € N,A: > 1; Auadier (1989) contains constructions for arbitrary n^ional a (see 
also Ausdier’s paper in Euskai et al. (19d2)). Let us illustrate for a » | how 
the factor 2 scheme has to be adapl^ We start again &om a multiresolution 
analysis, defined as in (5.1.1)-(5.1.6), vitli § instead of 2 for <J|ie dilation factor. 
We have again ^€VqC VLi * Span{^(| *-n)}, so that 


咖卜 X h ° n4> {l x * n ) - 


(The reason for the superscript 0 wilt soon become clear.) Consequently, 


M x - 2 £}~ W 0 ( 妾 ar 

and orthonormality of the ^( - - 2f) implies 



3 ^(? a ； — n ) ， 
(10.4.1) 


E h n^ = (10.4.2) 


On the other hand, -1) is also in V^, and can therefore also be written as a 
(different) linear combination of the ^(| x - n), 


0(^-1} = yf god …). (10.4.3) 

Orthonormality of the </>(x _ 2 /- 1 )， and orthogonality of the <(>{x -2^-1) with 
respect to the 2t) then implies 


5^ ^n-« * * 

n 

^ ^n-U 85 0 - 
n 

All this means that we hove in fact tm mo-fiinctioua. 


mS(« 心 ， mj ⑹，義 Y ： h n^ - 

It 


(10.4.4) 

(10A5) 
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What about mi? We define again, for j € Z, the space to be the orthogonal 
complement in of Vj. Note that V_i is generated by the 凑 (| x —n), n € Z, 
or, equivatentiy, by the even integer translates of three fiinctioos, namely 

^-^)- 1 ), t€Z t 


corresponding to n = 3^, n = 3/ + 1, and n = 3^ + 2. The space Vq is generated 
by the 2Z translates of two functions, <p(x-2£) and ^(x-2/*-l), i€Z. It fdlows 
that the complement space Wp is generated by the 2Z translates of a single func¬ 
tion, W 0 = Span {*}){■ - 2n); n 6 Z} v (“H^ is half tiie^aecf V 0 . n ) We 
therefore an orthonorm&l basis of the type % ， * ⑻ =(f )’" 2 爹 
j 、fc € Z. This function can also be wr^tea as a linear oombinsticHi 
舍 (§ ®-n). 

垆 (：）= 

and orthonormality of the i>(x - 2n)，plus t»rth(^onality with respect to the 
4>{x — 2n )， <i>{x - 2n — 1) implies 一 

9n 9n-3t - ^eo , - (10.44) 

n 

9n ^n-it ~ 3n / ― 0 - (10.4.7) 




With the definition mj^) = ^c*** n «, the conditions (10.4.2), (10.4.4)- 

(10.4.7) are equivalent to the unitarity of the matrix 

/ 饥 S(C) ^o(0 m i ⑹ > 

^ + y) ( 4 + f) m, ( { + f) • (10.4.8) 

This matrix looks identical to (10.2.1), but this aimilaxity is deceptive: in (10.4.8) 
the first two columns are both given by low-pass filters, because th^y are i>oth 
related to the scaling function (f> (mg(0) =* 1 = mj(0)) t whereas the second 
column in (10.2.1) corresponds to a high-pass filter- Such mj，mi can indeed be 
constructed (see Auscher (1989) for det^s and, graphs). Note that and 
are closely related. The Fourier transforms of (10.4.1), (10.4.3) arc 

4>(0 = 4 ^ (盖 《) ， ^(0^ 581 4 (f () > (營 《） ， ( 10 - 4 - 9 ) 

implying 

mg{<) HO = ^ mJ(C) HO , 
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which should hold for almost all (• If 》 is continuous, then the following argument 
shows that 4> vanishes on some intervals. Since 0(0) ― (2 开 ) _1 / 2 , there exists a 
so that for |C| < ot ， |^(C)| > (2^) _1 / 2 /2. Consequently, for |C| < a, 

^o(C) = c 3<C/2 mj(0 , 

or 1 

77i8« + 27r) - -c 3<</ * 2 mJ(C + 27r); 

since mj are also 27r-periodic, this implies m§(C + 2 tt) = 0 — mjK + 27r) for 
JCI < Q- It follows that |0(§ C + 3?r)| = 0 for |C| < a. In particular, this means 
that cannot be compactly supported (compact support for *f> means that ^ is 
entire, and non-trivial entire functions can only have isolated zeros). ' 

Nevertheless, subband filtering schemes with rational' noninteger dilation 
factors, in particular with dilation have been proposed and constructed by 
KovaCevid and Vetterli (1993)，with FIR filters. The basic idea is simple: start¬ 
ing from c 0 , one can first decompose into three subbands, by means of a scheme 
as in §10.2, and then regroup the two lowest frequency bands by means of a 
synthesis filter corresponding to dilation 2; the result of this operation is c 1 , 
while the third, highest frequency band after the first decomposition is d l . The 
corresponding block diagram is Figure 10.4. If all the filters are FIR, then the 
whole scheme is FIR as well. But didn’t we just prove that there does not exist 
a multiresolution analysis for dilation factor | with FIR filters? The solution 
to this paradox is that the block diagram above does not correspond to the 
construction described earlier. A detailed analysis of Figure 10.4 shows that 
this scheme uses two different functions 4> l and with Vo generated by the 
<!^(x - 2n), <f> 2 (x — 2n), n € Z. The argument used prove that <f> cannot have 
compact support then no longer applies, and <j> l % <j> 2 can indeed have compact 
support. The analog of (10.4.9) is now an equation relating the two-dimensional 
vectors 0) ， however, and it is hard to see how 

to formulate conditions on the filters that result in regularity of 今 1 ， <f> 2 - 



Fig. 10.4. Btcck diagram oorretpondins to a subband filtering with dUation factor as 
constructed in KovaitvU and Vetterli (1993). 

One may welllvoiider what the rationale is for these fractional dilation factors. 
The answer is that they may provide s sharper frequency localization. If the 
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dilation factor is 2, then ^ is essentially localized between v and 2ir t as illustrated 
by the Fourier transform of a ‘* typical” 矽 in Figure 10.5. For some applications, 
it may be useful to have wavelet bases that have a band^dth narrower than one 
octave，and fractional dilation wavelet bases are one possible answer. A different 
answer is given in Cohen and Daubechiffl (1990), summarized in the nact section. 



10.5. Better frequency resolution: The splitting trick 

Suppose that h n ,g n are the filter coefficioits associated to an ortbonormal 
wavelet basis with dilation factor 2, i.e., 

^ ^ £ hne~ in( 

satisfies 

|mo(0| a + |moU + 7r)| 3 = 1, (10-5.1) 

and , 

9n — (~*l) n 厶 -n+1 ♦ 

Then we have the following lemma. 

LEMMA 10.5.1. Take any function f (not necessarily connected to wavelets 
in any way) bo that the /(* — n), n € 2 art orthonormcd. Divine 

Fi(x) = ^2 hnHx - n) 
n 

巧 ⑻ =Yi Snf(x-n ). 
n 

Then {Fii - 2fe),F a (- - 2A ;)； k € Z} u an erthonormal basis for 
E «= Span {/(• - n); n € Z] • 、 
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Proof. 

L Since / dx f(x) f(x - n) « ^ n *o» we have 

Jd^ |/(0| a e-^=6 n , 0 , or ^ |/« + 2^)| 3 = {2^ a.e. (10,5.2) 

2 Fi(0 - 53 /»〆-—/(« = V5 mo«)/(« . (10.5-3) 

n 

Consequently, ^ 

乙 |秘 + 叫| 2 二 4 - ^ + ^ + ^ + 2irfc)|3 ] 

= 2(2ir)- 1 {|m 0 (^)|H|mo« + ^P] 

(use (10.5.2) and (10.5.3)) 

= 7T _l (by (10.5.1)). 

This implies 

Jdx ^(x) f\(x- 2k) = Jd^ |Fi(^)| 2 c- 2 ^ 

^de|Fi« + ^)| 2 c~ 2<t « = 6^ , 

氣 * 

The orthononpallty of the Fa(* - 2k) is proved analogously, using = 
>/2 e^ xi mo((, + tt)/( 0. 

3. Similarly, 

EA(€ + c-_ ， 

' 1 (10.5.4) 

and 

= 5^ [A« + 2irk)F 2 (^2nk) + AK + ^ + 2trfc)/ ； i(C + it + 2irfc)] 

= 2 (2?r 广 1 [rnoK)moK + ，)# + t7ioK + 7r)moK)^ +ir) ] 

- 0 , 

which proves that the i*i(* — 2k) and the 朽 (® - !W) are ortbc^QDal ， 

4. Finally, the F\ (- - 2fe), F a ( - - 2k) span all of 五 because 

f(x) = ^2 lf^3i Fi(a: + 2^) + 53 / Fa(* + 2^)] t (10.5.5) 


J dxFx 


(x)F2(x - 2k) 
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f(x — 1) = ^2 [iWf i ^i(* + 2i) + 92 t+i Fa(ar+ 2/)J . (10.5.6) 

t * 

We have indeed 

i t 

~ [^(0 + mo(^ + ir) mo(C)/(C) 

+ [饥 1(() + mi(^ + 7r)J mi (C)/(0 

= f{0 {[kMO 卩 + l m i(OI 2 ] + |mo(^)mo(^ + ») + mi+ ?r)]J 

which proves (10.5.5). Similarly, 

[/i 2m W/U0 + [ 仍 m 3 秘 ）. 

=<*-“ - mo(e + it) moK)/(^) 

+«™* € [mj(C) *- mi(C + w)] 

- e ，)， 

which proves (10.5.6). ■ 

Lemma 10.5.1 is the flitting tridc": it shows that wavelet filters can be used 
tq split any space spanned by orttmonnai functions /(x — n) iiito two parts. 
Since mo, m t “live” on different frequency ranges (see Figure 10.6), fcfee splitting 
trick corresponds to cutting the support of / into slices, and allotting alternate 
slices to Fi and F 2 . 

We can apply this splitting trick to the (approximately) one-octave band' 
width space Wo spanned by the 妒 (.-fc) in a one>dimensional muitiresolution 
analysis with factor 2. We define 

hn^{x~ n) ( i^{x) = 53 - n), 

n n 

where the knJn need not be the same filter coefficients as used in the construc¬ 
tion of ^ itself. Then 

W 0 — Span {V»( - *)； k 6 Z} 
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0 2r 4« Gk 

Fig. 10.6. Graph* of |iomo(C)l ond «a»lh prm^ iefined a$ tn $6.4. 

Since the -spaces are all dilated copies of w« can construct corresponding 

orthononnal bases £or each and thdr imimi is again a basis for L 2 (R)= 
® W,. We define thus 

- 2**" 2 ^(2^-2/), « 2-" 2 ^ 2 {2~ 3 x - 2t); 

the j y £eZ} constitute an ortbo&omai basis of L 2 (R). Since H 2 

are obtained by “splitting* ， 成如肋 d 也 both have better frequency localization 
than 妒 itself (at the price of having larger supports in x-space!}. The splitting 
up of frequency space corresponding to the on one hand, and the W}, Wf on 
the other iuuid, is represented scbematic^jr ia F%ure 20-7, Note that firequeocy 
is stiU treated logarithmically, even with the ^ k . 



Flo. 10*7. Schematic represeniaiion of the ^^tiing o/ {corretponding more or lest to f 
a barukridth of 9 ) into (*) W u W 2 , and into <b) H^ ， H? ， W}, Wj, andVi. 

By construction, ^ l (C) =： mo(0 雀 (0, wti ⑹ 0(^). It follows 

that 2|^(^)| 2 , a8Ula8tratedb> Figure 10.8, which also shows 

that rjf 2 do indeed ^split” 彡 into two pieces, corresponding to its lowest and 
highest ^equency halves, 5 * 

Computing the coe^cients of a function with respect to the 分 jj^ k cm 
again be done via a Bubband filtering sdieme, m whidt one additional step of 
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0 x 2x 3« 4x 


Pig. 10.8. Graphs of | 雇 U 《 )l ， the tow-paM ji^er It efcdMn «ffuo< to iomo(0, 
aa defined in §6.4. 1%t dotted tine is ihe graph of VS 1^(01- 


high- and low-pass splitting is added after the “stand&rd” high-pass filtering. 
Schematically, we have now Figure 10.9. Note that the dilation factor 4 scheme 
proposed at the end of §10.2 (derived from a factor 2 scheme) also contains these 
functions 矽 ' 矽 2 . (The wavelets in that scheme are essentially 秋 x 、，the original 
wavelet for factor 2, and y/2 ^> 1 (2x) f y/2 ^ 2 (2x) t with 螃 、 f defined as above.) 

If one works with a tensor product multiresolution analysis in higher dimen¬ 
sions, then the splitting trick can be applied in a selective way. Figure 10.10 
shows how one can, e.g., use the splitting trick in two dimensions to achieve an 
orthonormal wavelet basis with better angular resolution in the frequency plane 
than a “standard” wavelet basis. Figure 10.10a visualizes the construction of 
§10.1 in the frequency plane: the small central square corresponds to (say) V 0 ； 
adding to it the two vertical rectangles corresponding to Wq = Wo ® Vo, the 
two horizontal rectangles for Wj ~ Vo ^Wq and the four corner squares for 
= VVb ® leads to the bigger square representing The structure 
then repeats in the next annulus, to constitute V_ 2 - The angular resolution in 
the Fourier plane of this scheme is not vary good, aa shown by tb6 figure. Fig¬ 
ure 10.10b shows what the same two-dimensional constructicw looks like wh«i 
one starts from a one-<Umensional multiresolution analysis with dilation factor 
4, as given at the end of §10.2. In this case the one-dimensiooal scheme has al¬ 
ready three wavelets, so that the two-dixnfiiisionBl product scheme ends up with 
2 x 3 + 3 2 = 15 wavelets. Figure 10.10b represents one step (with dilation 4) 
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</. 知 *) - - - {/, ^i,k) 

(f^U 

Fig. 10.9. Schematic representation o/ the different filtering operation* vAen working 
with "split" wavdfts^ 

in the multiresolution scale, as compared to two steps (with dilation factor 2), 
i.e., two successive annuli in Figure 10,10a. The central part of the two pictures 
is identical; the only difference between the pictures is that the outer an- 
oulus of Figure 10,10a is split into many pieces to give Figure 10-10b, while the 
inner amiulus is untouched. This corre^onds to a Splitting of one level out of 
two” in terms of the splitting trick lenuna« as pointed out above. The result is 
good angular resolution for some wavelets (ctMrresponding to the outer layer in 
Figure 10.10b), bad for others (corresponding to the most central rectangles in 
Figure 10.10b). 

Figure 10.10c shows the same picture again, with two steps in & multireao- 
lution analysis with dilation factor 2, but a product structure starting from 
the two 去 octave bandwidth wavelets constructed in this section rather than the 
one octave bandwidth wavelet Hie scaling, toc^ion is the same, but there 
are now 2 x 2 + 2 2 = 8 wavelets (m opposed figure 10.10a, and 15 for 

Figure 10.10b). Figure 1 乐 10c can be c^tained from Figure 10.10a by splitting 
every annulus* (inner as well as outer) into halves fay cuts in both horizontal and 
vertical directions. This improves the angular resolution on the squares in the 
comers (corresponding to the of Figure 10.10a), but does nothing for the 
angular resolution of the rectangles (corresponding to WJ or WJ in Figure 2a), 
which were split better in the outer annulus of Figure 10.10b. The best angular 
resolution can be obtained by giving up the product strudiiife aitogeth 枕 and 
just carving up every one of the spaces of Figure 10.10a vertically and/or 
horizontally, by applying the “splitting tridc 0 in x and/or y, until the desired 
r^olution is achieved. An example is giv^ln Figure lO.lOd. This still corre- 
^>onds to an orthonorma) basis, and to a &st algmthm for decompoeing and 
reconstructing functions, although the ongaiiizatioii is somewhat more compkx. 
If even better angular resolution is reqiurod, then one can repeat the splitti 明 
tridc where and as many times as oecenary. 

10.6. Wavelet packet bases. 

The better resolution wavelets of the previous dection are in fact oijy special 
cases in a beautiful construction of O^finata and Meyer, called wavel^; padoets. 




332 


CHAPTER 10 



FiO. 10 10 Vuudk 
two- dimensional mufti ： 


altzaiton 

ruahtko 


of the 


atton I 
etplo* 


tn the Fourier plane 
med in the text. 


by vanoiu 


The present section is only a short description of their construction; more details 
can be found in, e g., Coifoian, Meyer, and Wickerhauser (1902), and applications 
to acoustic signals and images are given in Wickerhauser (ld90 t 1992). 

Start with a “usual” multiresolution analysis for factor 2, and ^condder only 
the VJ, Wj spacea with j < 0. The decompesition 


L 2 (R)^V 0 B 


,% w r 


corTespoiids to a frequency splitting as schematically represented in Figure 10.7a. 
Heuristically, W-\ has 1< twice the size* of Vo and Wq (which have the ""same 
size” ）， W -2 has ^four times this siae,** etc. One can imagine reducing all of 
them，via the splitting trick, to subspaces of the same size; W~\ gets split once, 
WLj twice, etc. This corresponds to defining a host of functions 奴 
where ^ stands for the original W^gspace (and for the number of splittings this 
space lias undergone), and tj = 0 or 1 indicates the choice, mo or mi, at jth 


splitting. Ejqplicitly, 
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h ,e t (0 = n'( 2 D rn 1 (2- / - 1 0 0(2- / - 1 O 

J = 1 - 

j=i 

Clearly, the axe all linear combinations of the — k) t and 

the splitting trick lemma (applied £ times) proves that {ip£， ei ，. i£< (- — n); 
ei,. • ， e/ = 0 or 1， n € Z} is an orthonormal basis of Span { 矽 (2 名 • —k); fc € Z}= 
It follows that {^, Cl , , e ((- - n); € € N, n G Z,ei ,•••,€； = 0 or 1} U 
{<!>(• — n); n € Z} is an orthonormal basis for L 2 (R). Note that this basis corre¬ 
sponds to the integer translates of functions which all have more or less equivalent 
frequency localization (in bands of width more or less tt, starting with j^[ < 7r 
for the 0(- — n), tt < |^j < 2 tt for — «), - - .). n This is very similar in flavor 
to the windowed Fourier transform and the Wilson bases of §4.2.B, while still 
having the same ease of computation, via subband filtering schemes, as wavelet 
bases. 

There are of couree many intermediate solutions between wavelets on one 
hand and the wavelet packet basis described above: cme may choose to split 
some W-g spaces less often, or to split some of its subspaces more than others. 
Every such choice corresponds to an orthonormal basis; mcHreover, there exist 
efficient algorithms (based on (imputations of the “e 诚 ropy of a function” with 
respect to the different splittings) to determine which of this whole library of 
choices is the most efficient for given signal; see e.g” Coifinan and Wickerhauser 
(1992). 

10.7. Wavelet bases on an interval. 

All the one-dimensional wavelet constructions we have discussed so far lead to 
bases for L 2 (R). In many applications one is interested in only part of the real 
Une: numerical analysis computations generally work on an interval, images are 
concentrated on rectangles, many systems to analyze sound divide it in chunks. 
All tlifse involve decompositions of functions / supported on an interval, say 
[0,1]. One o>uld f of course, decide tb use standard wavelet bases to analyze /, 
setting the fraction equal to zero outside [0,1]，but this introduces an artificial 
“jump” at tbe edges, reflected in the wavelet coefficients. 12 It is, nuneover, not 
efficient computational. It is th^fore useful to develop wavelets adapted to 
u life on an interval." 

A first way of achieving this is to use the periodized wavelets described in 
§9.3. These are computationally 哗 dent, but using them amounts to analyzing 
the periodized function /, d^ned by f(x) = f(x — L^J) (where [xj denotes 
the largest integer not exceeding x) t by means of the usual (non-periodized) 
wavelets. Unless / is already periodic, we have again introduced a “jump” at 
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the boundaries 0,1, which will be reflected by large fine scale wavelet coefficients 
near 0 and 1. 

There exists another solution which does not present this inconvenience, pro¬ 
posed by Meyer (1992), based on orthonormal wavelet bases with compact sup¬ 
port. In this construction, the wavelets with a support contained in [0,1] that 
does not reach either 0 or 1 are kept as are, but this family is supplemented at 
the edges by specially adapted functions. Let us illustrate how the idea works 
on the half line rather than an interval. This simplification allows iis to deal 
with only one boundary, and to disregard the adaptations needed at the coars¬ 
est scales, where both boundaries of [0,1] have to be dealt with simultaneously. 
Define 

6 ha ^(x) - i 多 j ，* ⑷ if 工 2 0 , ， 

%， k 1 } \ 0 otherwise ; 

V 严 =Span ; kEZ}. 

The space V^ half can also be viewed as the space' of all restrictions to [0, oo) 
of functions in Vj. If we suppose that the original scaling function 0 has 
support [0, 2N - 1], then = 0iik < —2N + 1; we therefore only consider 

the with k > —2N + 1. All but 2N — 2 of these are untouched by the 
restricting procedure: = 0 Jt jt(x) if A: > 0; these functions are therefore 

still orthonormal. The 2N - 2 ftmctions 0^ lf , k = —1, • • •, -(2JV - 2) are inde- 
of each other and of the (j>j f k with A: > 0. Define now to be the 

orthogonal complen^nt in of If, for convenience, we shift t/? so that 

it is also supported on [O^N — 1], then the (r^trictions of to [0, oo)) 

are clearly in Wj 1 ** f if A: > 0, since they are orthogonal to all the and lie in 

V^ f . What about the with k — —1, • • •, ~(2N — 2)? (If fc is even smadler, 
k < ~2N + 1, then = 0.) It turns out (see Meyer (1992)) that the 
with k — -iV ,-(N + 1), • • •, —(27V - 2) axe in V^ half , i.e” they are orthogonal to 
The other k — - 1 , • ■ * , —(N — 1) contribute to in fact, we 

have that 

fc>-(2iV-2)}u{^f; k > -N(-l)} 

is a (non-orthogonal) basis for . 13 In order to orthonormalize this basis’ <wae 
proceeds in the following steps: * 

(1) Ortfaonormal^e the k = —1, •. • ， —(2N — 2). The resulting functions 
<^ fc , k = —1 ， … ， —(2N—2) are automatically orthogonal to the 知， * ， k>0 t 
and together they provide an orthonormal basis for 哈也 .If we define 
( ' 
hk^) = 2- J ' /2 j€Z, = -(2^-2), 

then fe > 0} U k = —1 ， … ， —(2N — 2)} is an orthonormal 

basis for for any j € Z. 
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(2) Project the A: * _1 ， … ， 一 (N — i) onto 勢 


< = I ： it)k. 

• 外 

(3) Orthonormalize the V*f • The resulting +*， fe = -1, …， -(N - 1), together 
with the ^o,* f » * 2 0, provide an orthonormal basis for We can 

again define 


A.fc ⑻ 




€2, Jb = -1,. ..-(N-l); 


then {^,fc ； k - -1,- •, ~(N- l)}u{0,|,jk ； > 0} is an orthonormal basis 

for The union of all these twses (j ranging over Z) gives a basis for 

i 2 ([0,oo)). 

The resulting bases are not only orthonormal bases for X 2 ([0,oo)), but provide 
also unconditional bases for the Holder spaces restricted to the half-line (i.e, 
they even handle regularity properties at 0 “correctly” ）， etc.; see Meyer (1992) 
for proofs. To implement all this in practice, one needs to compute extra filter 
coefi^ients at the boundaries, corresponding to Ihe expansion of the k — 

—l, - 、一 (iV - 1) ， 4>Q tkt k = -1 ， " ，一 (2W — 2)，in terms of the t - 

-1 ， … ， -(2N - 2) and the / — 0, • • •, AN - 5. These can be computed 
from the original ht\ tables are given in Cohen, Daubechies, and Vial (1992); 
this paper also contains an alternative to Meyer's canstruction, involving fewer 
additional functions at the edges (only N instead of 2N - 2), while still handling 
the regularity properties correctly, even at the edge. 

One last remark about wavelet bases on an interval. In image analysis, it 
is customary to treaty border effects by extending the imag^, beyond ^be bor¬ 
der, by its reflection: thia extension avoids the discontinuity that follows from 
periodization or extending by zero (although th 枕 e still is a discontinuity in the 
derivative, however). It is well known that this means that border efiEacts are 
minimized, and that no extra coefficients (to deal with the borders) have to be 
mtroduced, provided that the filters used are symmetric. The same trick can 
be used to provide biorthogonal wavelet bases on [0,1], with much less effort 
than the orthonormal wavelet basis on the interval of Meyer (1992) or Cohen, 
Daubecbies, and Vial (1992). 

If / is a function on R, then we can define & function on [0,1] by fold¬ 
ing" its graph at 0 and 1. The first “fold,” at 0, amounts to replacing f(x) 
by f(x) + /(-ac). Folding back the two tails (one from the origm&l /, the 
other from the folded over negative part) sticking out beyond 1 leads to f(x) + 
f(-x) + /(2 - x) 4- f(x + 2). If we keep folding like this, then we end up with 

/ foM W = [ /(* - 20 + [ / ⑼ -*). (10.7.1) 

teZ ieZ 

Note, for later convenience, that 14 

「dx f told (x) s fold (x) = f°°^dxf(x) . (10.7.2) 

Jo 九 00 


(10.7.1) 
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T)oke now 岭，必 ， two wavelets which generate biorthogonal wavelet baaesof Z^ 2 (R)# 
with iBtisociated scaling Ainctions 0 ，多 ， as constructed in §8.3; assume also tha 拿 
洽，孑 are symmetric around 0(1 - a) = 0(x), 不 (l -x) — j>(x) t and that 矽 ，表 
are antisymmetric around 矽(1 —:} = -^{x) } 令 (1 - x)= - 岑 (i). (Example^ 
were constructed in §8.3.) Apply the folding” technique to the i>j % k and 

峨 ( ar ) = - 2 -川之 -*) 

t^T> 

Ar*r m 52 iH2 十 1 龙 - 2 - J x - k) 

i^z 

=^(2~ j x - 2 十 1 卜 fc) ; 

e 

-2-" 2 - 2~ j+1 e + 1 + A:); (10.7.3) 

^ I^Z 

is defined analogously. We will restrict our attention to j < 0, or j = -J 
with J ^ 0, for which (10.7.2) can be rewritten as 、 " 

te% 

Fbr good measure we also define 冷找 *, since ㈣ a:) = ^(1 - a:), 彡 (*)= 

^(1 - *), we find 

t€t 

Obviouaiy, ~ for m € so that we only need to consider 

the values At « 0, • * -, 2 J+l - 1. Moreover, ^^ 2J+1 _ fc _ l ^ which means 

we can restrict ourselves to only fc s= 0, - 1. A similar argum«it shows 

that we only need to consider the 畛 5% for fc = 0,- 1. Remarkably，the 
4^ k and with 0 < k,k f < 2 J - 1, are still biorthogonal on [0,1]. To 

prove this, use (10.7.1): 



鉍 z 

*» ( 10 . 7 . 4 ) 

iel 

(b6caiweO<ib,A: / <2' / -l), 

This biorfchogonality implies^ among other things^ that the ， A?; 0,… ， 2 J _ 
1 are aD indep 棚 d 组 t，and provide a basis for Vj^j 6 = {/ fold ; / € V~j}- (The 
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tame is true lor the 於 f fc .) We can also define spaces by ' 

{/*****;/€ WLj}. Obviously, is spanned by the Jfe »0,*** # 2' / - l* 
Moreover, computations similar to (10.7.4) show that 

f ^ 矽％(:) ^ fc ， (x) = 0 , 

Jo 

乂 1 ㈣ 樣, w ; 〜， 

proving that 丄 and that the 奶心， 0<fc<2' , -lare independent. 
It follows that the. folded" structures inherit ail the properties (nesting of the 
spaces, biorthogonality, basis properties,* - *) from the unfolded originals. The 
filter coefficients corresponding to these folded blorthogdiial bases are likewise 
obtained by folding at the edges cotresponding to x = 0,1; if 命、士，♦、击 are 
compactly supported, then only the filter coefficients n^r the borders will be 
affected. Examples axe given in Cohen, Daubediies, and Vial (1992). Because 
analyzing / on [0,1] with these folded biorthogonal wavelets amounts to the same 
as extending / to all of R by reflections and analyzing this extension with the 
oHgiiial biorthogonal wavelets, we cannot hope, however, to characterize Holder 
spaces on [0,1] beyond Holder exponent 1 with this technique. This is progress 
with respect to what periodized wavelets can do, but it is less pelrformant than 
the orthononaal wavelet bases on [0,1]. For more details^ see Cobea, Daub«chies, 
and Vial (1992). 


L One example is the following. Let r be the hexagonal lattice, 
r = {niei + n^ea ； ni,n 2 € Z}, where ci = (1,0), t% — (1/2, V5/2); T de- 
finesa partition of R 3 into equilateral triangles. Define to be the space of 

continuous functions in L 2 (R) that are piecewise affine 畑 these triangles 


The ortjionormal basis for thi» multires^^ion analysis is constructed in 
Ja£hrd (1989). Biorthogonal bases of compactly supported 窘 with 
this hexagonal symmetry are constructed in Cohen and 


Schlenker (1991). 

'喊 r 

%* one^limensional conditions of §5.1 can also be cast in a matrix 
that case i>{() * mi(i/2) ^/2), and t^e conditjona are 

+ 卜 (£ + 冗 )l 2 = 1, ifni(fl| 2 + + ir)| 2 = 1 ， mo{0 m“《)+ 

SiK + ir) « 0, ensuring the otthonortatiality of the { 知 ， n ; n € Z }， 
of ti € Z} and the orthogonality of these two 

Tespectitel^ But these conditions ve equivalent to Che ri 

unitary. 


the 


matrix ( 


of vectors, 
rtSiTiiEement that 


*»»o(0 mi(€) 


3. If one prefere to index the entries 6f 1/ with the numbm 1, • • *, 2 n rather 


than entries of {0,1 } n » then one can renumber s € {0,l} n by defining 

+ 6 {I, --,2"). 
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4. At present, I know of no explicit scheme that provides an infinite family 
of mo, for <tilation &ctor 3, with r^ularity growing (Hroportionally to the 
filter support width. 

5. The same can be done for dilation factor 2, where the factor matrices are 

even simpler. The basic idea is that if |mo(Ol 2 + |»« 0 (之+开)卩 = 1， then, for 
any 7 € R, n € Z, = (1 + 7 2 )~ 1/2 [饥 0 ⑹ + 7c _i(2n+1)€ + 貫)] 

will also satisfy + |mf(C + 7 r )| 2 = 1 . If mo(0 = En^o 1 a«e~ 叫， 

then it is convenient to choose n = JV + 1 ， leading to mf(()= 
.All this can be rewritten in matrix form: 


匕 +3 4 




V c-^ +3 )« m?(C + 7r) 
=(1 + ?)-" 2 (二 




)( 


mo(0 


「 •(2 料 m moCe + ir )) 

The whole operation raises the degree ,of m<j 2.. One can, moreover, 
prove (Vaidyanathan and Hoang (1983)) that any trigonometric polyno¬ 
mial satisfying |mo(《) 卩 + |mo(C + ir )| 2 — 1 'can be obtained by let¬ 
ting products of sudi 7 -matrices act on two-tap filters. We have not 
uded this method m our constructions in §6.4 because it does not pre¬ 
serve the divisibility of mo by (1 + c— 吒)： imposing that the final m© 
is divisible by (1 + e~~ 处） leads to highly nonlinear constrsdnts on the 
parameters 7 ,, The method has the advantage, however, that it leads 
to easy implementations of the filters (using the directly), and that 
roundoff errors on the 7 ^ do not mar the exact reconstruction property. 

Anyway, a Bimilar matrix technique can be used lor more than two 
chaimeis, as shown in Dog^nata, Vaidyanathan, and Nguyen (1988) or, 
with mc^e practical matrix fectozs, in Vaidyanathan et al. (1989). T^iese 
matrix factorization techniqueB go back to the circuit theory work of Bele- 
vitch (1968). 

64 Tl^is method for determining mi,m 2 was indicated to me by W. Lawton 
and R. Gopinath (personal communication, 1990). / 

7. Such a ooe-dimensioiial filter would not be useful in practice, however! 

8 . This has been observed by many authors. The oldest reference seems to 
be McClellan (1973). One can also,re^ace the one-dimensional coe^ by 
(a cos( + (1 _ <x) cos C)/2 for a € K arbllxary, but there seems little point 
in not making the symmetric dboice 0 = 5 . 

9. One can argue that some of the h4^er<Hme&8ioiial schemes discussed in 
§ 10.3 correspond to noninteger dilations，In two dixneofflons, for example. 


the matrices ^1 — (1 _}) and I>a 


schemes 
lenfflons, 1 
(1 "*}) both satisfy D* » 16 Id, 
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80 that a single dilation can be viewed as a dOalion by \/2 (combined with 
a rotation and/or a reflection). 

10. If one also considers orthonormal wavelet bases not resulting from multires¬ 
olution analysis, then it is not known wheth^ irratidiial dilation factors 


ate allowed or not. 

11. Fbr large £, the concentration of .， ct is not as good as this discussion 
suggests, however; see Coifinan, Meyer, and Wkdcerhauser (1992). This is 
already noticeable on Figure 10.8, where 摹 ' 朵 2 have “sidelobes.” 


12. In image analysis one often extends / beycmd the boundaries of the image 
by reflection; this extension is continuous, but its derivative still has a 
“jump.” We come back to this at the end of §10.7. 

13. Some of these assertions are highly non-trivial! A sizeable part of Meyer 
(1992) is devoted to their proof ； simpler proofe have recently been found 
by Lemari^ and Malgouyres (1991). 


14. We have 


/ dx / fold (rc) ^{x) 
ro 

= 石乂 dx [/(x + 2i)g(x + 2l r ) + f{x + 2()g(2£ f ~x) 

+ f(2i- x)g(x^2e r ) + f{2i~ x)g(2£ / - x)] 

„ f 2t+l _ ^ / - 2/+1 * _ 

J 办 f(:)9(: + 2m) + 5^ . dx f(x)g(2n - z) 

t,m ^ t,n ^ 

f 2t _ r2f _ 

+ V / dy f(y)g(2m , - y) + V / dy f(p)g(y + 2n0 

=f dx f(x)^2g(x+~2m)^- f dx /(x) (/(2 m-xj 

J~oo m J~oo m 

-f dx f(x)g told (x ). 

•/-oo 
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